Aug 25 23:59:43 devstack cinder-volume[83291]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 25 23:59:43 devstack cinder-volume[83291]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 25 23:59:43 devstack cinder-volume[83291]: we strongly recommend against using it for new projects. Aug 25 23:59:43 devstack cinder-volume[83291]: If you are already using Eventlet, we recommend migrating to a different Aug 25 23:59:43 devstack cinder-volume[83291]: framework. For more detail see Aug 25 23:59:43 devstack cinder-volume[83291]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 25 23:59:43 devstack cinder-volume[83291]: import eventlet # noqa Aug 25 23:59:45 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 25 23:59:45 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 25 23:59:45 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 25 23:59:46 devstack cinder-volume[83291]: INFO dbcounter [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Registered counter for database cinder Aug 25 23:59:46 devstack cinder-volume[83291]: DEBUG oslo_db.sqlalchemy.engines [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 23:59:46 devstack cinder-volume[83291]: DEBUG dbcounter [-] [83291] Writer thread running {{(pid=83291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 23:59:46 devstack cinder-volume[83291]: INFO cinder.rpc [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 25 23:59:46 devstack cinder-volume[83291]: INFO cinder.rpc [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 25 23:59:46 devstack cinder-volume[83291]: DEBUG oslo_db.sqlalchemy.engines [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 23:59:47 devstack cinder-volume[83291]: INFO cinder.volume.manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Determined volume DB was empty at startup. Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG cinder.volume.manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83291) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 25 23:59:47 devstack cinder-volume[83291]: INFO cinder.volume.manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 25 23:59:47 devstack cinder-volume[83291]: WARNING stevedore.named [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 23:59:47 devstack cinder-volume[83291]: WARNING castellan.key_manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 23:59:47 devstack cinder-volume[83291]: WARNING cinder.keymgr.conf_key_mgr [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG cinder.volume.drivers.lvm [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83291) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_concurrency.processutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_concurrency.processutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] CMD "cinder-rtstool verify" returned: 0 in 0.416s {{(pid=83291) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_db.sqlalchemy.engines [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 23:59:47 devstack cinder-volume[83291]: INFO cinder.rpc [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 25 23:59:47 devstack cinder-volume[83291]: INFO cinder.rpc [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 25 23:59:47 devstack cinder-volume[83291]: WARNING stevedore.named [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 25 23:59:47 devstack cinder-volume[83291]: WARNING castellan.key_manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 25 23:59:47 devstack cinder-volume[83291]: INFO cinder.volume.manager [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_db.sqlalchemy.engines [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83291) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 23:59:47 devstack cinder-volume[83291]: INFO oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Starting 1 workers Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Started child 83472 {{(pid=83291) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Full set of CONF: {{(pid=83291) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] ******************************************************************************** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Configuration options gathered from: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] ================================================================================ {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] allow_availability_zone_fallback = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] allow_compression_on_image_upload = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] allowed_direct_url_schemes = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] api_rate_limit = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] auth_strategy = keystone {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] az_cache_duration = 3600 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_availability_zone = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_host = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_stats_polling_interval = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backup_api_class = cinder.backup.api.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backup_name_template = backup-%s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backup_use_same_host = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backup_use_temp_snapshot = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] chap_password = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] chap_username = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_internal_tenant_project_id = 2623d595f85f432684b15e3185fc6739 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_internal_tenant_user_id = 7040a9b16c96469dac34c0e0bada44f9 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cloned_volume_same_az = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cluster = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] compression_format = gzip {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] compute_api_class = cinder.compute.nova.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] config_dir = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83472]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] config_source = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] control_exchange = openstack {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] debug = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] default_availability_zone = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] default_group_type = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] default_volume_type = lvmdriver-1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] disk_geometry = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_client_cert = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_client_cert_key = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_data_namespace = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_ssl_cert_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_ssl_cert_verify = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] driver_use_ssl = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] enable_force_upload = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] enable_new_services = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] enable_unsupported_driver = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] enabled_backends = ['lvmdriver-1'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] enforce_multipath_for_image_xfer = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] filter_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_api_insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_api_ssl_compression = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_ca_certificates_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_catalog_info = image:glance:publicURL {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_num_retries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance_request_timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] goodness_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] graceful_shutdown_timeout = 5 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] group_api_class = cinder.group.api.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] host = devstack {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_compress_on_upload = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_conversion_address_space_limit = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_conversion_cpu_limit = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_conversion_disable = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_upload_use_cinder_backend = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_upload_use_internal_tenant = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_volume_cache_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_volume_cache_max_count = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] image_volume_cache_max_size_gb = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] init_host_max_objects_retrieval = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] instance_format = [instance: %(uuid)s] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iscsi_target_flags = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iscsi_write_cache = on {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iser_helper = tgtadm {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iser_ip_address = 192.168.122.77 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iser_port = 3260 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_color = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_config_append = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_dir = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_options = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_rotate_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_rotate_interval_type = days {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] log_rotation_type = none {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] max_age = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] max_logfile_count = 30 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] max_logfile_size_mb = 200 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] max_over_subscription_ratio = 20.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] message_reap_interval = 86400 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] message_ttl = 2592000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] migration_create_volume_timeout_secs = 300 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] monkey_patch = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] monkey_patch_modules = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] my_ip = 192.168.122.77 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] no_snapshot_gb_quota = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] num_iser_scan_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] num_shell_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] num_volume_device_scan_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] nvmeof_conn_info_version = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] nvmet_ns_id = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] nvmet_port_id = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_max_limit = 1000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_ext_list = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_listen = 0.0.0.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_listen_port = 8776 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_use_ssl = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] osapi_volume_workers = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] per_volume_size_limit = -1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] periodic_fuzzy_delay = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] periodic_interval = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] project_id_regex = [0-9a-f\-]+ {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] public_endpoint = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] publish_errors = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_backup_gigabytes = 1000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_backups = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_gigabytes = 1000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_groups = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_snapshots = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] quota_volumes = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] rate_limit_burst = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] rate_limit_except_level = CRITICAL {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] rate_limit_interval = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] reinit_driver_count = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] replication_device = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] report_discard_supported = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] report_interval = 120 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] reservation_clean_interval = 86400 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] reservation_expire = 86400 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] reserved_image_namespaces = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] reserved_percentage = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] rpc_response_timeout = 120 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] run_external_periodic_tasks = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] scst_target_driver = iscsi {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] scst_target_iqn_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_down_time = 720 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] shell_completion = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] snapshot_name_template = snapshot-%s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] snapshot_same_host = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] split_loggers = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] state_path = /opt/stack/data/cinder {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] storage_availability_zone = nova {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] storage_protocol = iSCSI {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] syslog_log_facility = LOG_USER {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_helper = lioadm {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_ip_address = 192.168.122.77 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_port = 3260 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_protocol = iscsi {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] target_secondary_ip_addresses = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] trace_flags = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] transfer_api_class = cinder.transfer.api.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] transport_url = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] until_refresh = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_chap_auth = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_default_quota_class = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83472]: INFO cinder.volume.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_journal = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_json = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_multipath_for_image_xfer = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_stderr = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] use_syslog = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] verify_glance_signatures = enabled {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_api_class = cinder.volume.api.API {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_backend_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_clear = zero {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_clear_ionice = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_clear_size = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_copy_bps_limit = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_dd_blocksize = 1M {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_name_template = volume-%s {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_service_inithost_offload = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volume_usage_audit_period = month {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] zoning_mode = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_concurrency.disable_process_locking = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.auth_section = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.auth_type = password {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.auth_version = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.cache = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.delay_auth_decision = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.http_connect_timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.include_service_catalog = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.interface = public {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_password = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcache_username = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.region_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.service_token_roles_required = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.service_type = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.token_cache_time = 300 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.backend = dogpile.cache.null {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.backend_argument = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.backend_expiration_time = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.config_prefix = cache.oslo {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.debug_cache_backend = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.enable_retry_client = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.enable_socket_keepalive = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.expiration_time = 600 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.hashclient_retry_attempts = 2 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_dead_retry = 300 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_pool_maxsize = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_sasl_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.password = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.proxies = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.redis_db = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack sudo[83476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:47 devstack sudo[83476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.redis_sentinel_service_name = mymaster {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.redis_server = localhost:6379 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.retry_attempts = 2 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.retry_delay = 0.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.socket_keepalive_count = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.socket_keepalive_idle = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.socket_keepalive_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.socket_timeout = 1.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.tls_allowed_ciphers = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.tls_cafile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.tls_certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.tls_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.tls_keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cache.username = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] coordination.backend_url = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.asyncio_connection = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.asyncio_slave_connection = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.backend = sqlalchemy {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.connection = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.connection_debug = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.connection_parameters = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.connection_recycle_time = 3600 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.connection_trace = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.db_inc_retry_interval = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.db_max_retries = 20 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.db_max_retry_interval = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.db_retry_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.max_overflow = 50 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.max_pool_size = 5 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.max_retries = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.mysql_wsrep_sync_wait = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.pool_timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.retry_interval = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.slave_connection = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.sqlite_synchronous = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.synchronous_reader = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] database.use_db_reconnect = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.connection_string = messaging:// {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.es_doc_type = notification {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.es_scroll_size = 10000 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.es_scroll_time = 2m {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.filter_error_trace = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.hmac_keys = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.sentinel_service_name = mymaster {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.socket_timeout = 0.1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.trace_requests = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler.trace_sqlalchemy = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler_jaeger.process_tags = {} {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler_jaeger.service_name_prefix = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] profiler_otlp.service_name_prefix = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.enforce_new_defaults = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.policy_default_rule = default {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.policy_file = policy.yaml {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_policy.remote_timeout = 60.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.group = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.helper_command = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] privsep_osbrick.user = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.group = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.helper_command = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] cinder_sys_admin.user = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.auth_section = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.auth_type = password {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.cafile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.collect_timing = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.send_service_user_token = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.split_loggers = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] service_user.timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.auth_section = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.auth_type = password {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.collect_timing = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.region_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.split_loggers = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] glance.timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.backend_availability_zone = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.chap_password = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.chap_username = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.disk_geometry = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_client_cert = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_client_cert_key = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_data_namespace = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.driver_use_ssl = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.enable_unsupported_driver = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.extra_capabilities = {} {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.filter_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.goodness_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iscsi_target_flags = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iscsi_write_cache = on {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iser_helper = tgtadm {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iser_port = 3260 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.lvm_mirrors = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.lvm_share_target = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.lvm_type = auto {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.num_shell_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.nvmet_port_id = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.replication_device = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.report_discard_supported = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.reserved_percentage = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.scst_target_driver = iscsi {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.scst_target_iqn_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.storage_protocol = iSCSI {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_helper = tgtadm {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_port = 3260 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_protocol = iscsi {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.trace_flags = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.unique_fqdn_network = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.use_chap_auth = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_backend_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_clear = zero {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_clear_ionice = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_clear_size = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volume_group = cinder-volumes {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_reports.file_event_handler = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_reports.log_dir = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.backend_availability_zone = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.backend_host = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.chap_password = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.chap_username = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.chiscsi_conf = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.disk_geometry = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_client_cert = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_data_namespace = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.driver_use_ssl = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.extra_capabilities = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.filter_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.goodness_function = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iser_helper = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iser_ip_address = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iser_port = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.iser_target_prefix = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.lvm_conf_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.lvm_mirrors = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:47 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.lvm_share_target = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.lvm_type = auto {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.num_shell_tries = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.nvmet_port_id = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.replication_device = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.report_discard_supported = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.reserved_percentage = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.scst_target_driver = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.storage_protocol = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_helper = lioadm {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_ip_address = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_port = 3260 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_protocol = iscsi {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.trace_flags = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.use_chap_auth = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_clear = zero {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_clear_size = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] lvmdriver-1.volumes_dir = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.ssl_version = {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_notifications.driver = [] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_notifications.retry = -1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] oslo_messaging_notifications.transport_url = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] key_manager.fixed_key = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.barbican_api_version = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.barbican_endpoint = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.barbican_endpoint_type = public {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.barbican_region_name = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.cafile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.collect_timing = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.number_of_retries = 60 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.retry_delay = 1 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.send_service_user_token = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.split_loggers = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.verify_ssl = True {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican.verify_ssl_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.auth_section = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.auth_type = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.cafile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.certfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.collect_timing = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.insecure = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.keyfile = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.split_loggers = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] barbican_service_user.timeout = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.approle_role_id = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.approle_secret_id = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.auth_method = approle {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.auth_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.kv_mountpoint = secret {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.kv_path = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.kv_version = 2 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.namespace = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.root_token_id = **** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.ssl_ca_crt_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.timeout = 60.0 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.token_file = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.token_role = None {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.use_ssl = False {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 25 23:59:48 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] ******************************************************************************** {{(pid=83291) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 25 23:59:48 devstack sudo[83476]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:48 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:48 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:48 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.348s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 25 23:59:48 devstack cinder-volume[83472]: INFO cinder.brick.local_dev.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:48 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:48 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:48 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG cinder.brick.local_dev.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83472) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 25 23:59:48 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:48 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:48 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:49 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.506s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:49 devstack sudo[83768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:49 devstack sudo[83768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:49 devstack sudo[83768]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:49 devstack sudo[83863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 25 23:59:49 devstack sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:49 devstack sudo[83863]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.237s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:49 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:49 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:49 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:50 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:50 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:50 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:50 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:50 devstack sudo[84098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:50 devstack sudo[84098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:50 devstack sudo[84098]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:50 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:50 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:50 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:51 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.327s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack sudo[84186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:51 devstack sudo[84186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:51 devstack sudo[84186]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: INFO cinder.volume.drivers.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:51 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:51 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack sudo[84251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:51 devstack sudo[84251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:51 devstack sudo[84251]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:51 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:51 devstack sudo[84282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:51 devstack sudo[84282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:52 devstack sudo[84282]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:52 devstack sudo[84285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:52 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:52 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:52 devstack sudo[84294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:52 devstack sudo[84294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:52 devstack sudo[84294]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:52 devstack cinder-volume[83472]: INFO cinder.volume.driver [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Driver hasn't implemented _init_vendor_properties() Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG cinder.volume.driver [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83472) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_db.sqlalchemy.engines [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83472) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writer thread running {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG cinder.db.api [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Building query based on filter {{(pid=83472) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG cinder.image.image_utils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83472) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 25 23:59:52 devstack cinder-volume[83472]: INFO cinder.keymgr.migration [None req-f03c0517-0232-4347-9330-2d4d30039360 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 23:59:52 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:52 devstack sudo[84298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:52 devstack sudo[84298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:53 devstack sudo[84298]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:53 devstack sudo[84301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:53 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:53 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:53 devstack sudo[84304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:53 devstack sudo[84304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:53 devstack sudo[84304]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:53 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:53 devstack sudo[84310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:53 devstack sudo[84310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:54 devstack sudo[84310]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG cinder.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Notifying Schedulers of capabilities ... {{(pid=83472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 25 23:59:54 devstack cinder-volume[83472]: INFO cinder.volume.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Driver initialization completed successfully. Aug 25 23:59:54 devstack cinder-volume[83472]: INFO cinder.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Initiating service 2 cleanup Aug 25 23:59:54 devstack cinder-volume[83472]: INFO cinder.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Service 2 cleanup completed. Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG cinder.service [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Creating RPC server for service cinder-volume {{(pid=83472) start /opt/stack/cinder/cinder/service.py:231}} Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG cinder.service [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83472) start /opt/stack/cinder/cinder/service.py:237}} Aug 25 23:59:54 devstack cinder-volume[83472]: INFO cinder.volume.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:54 devstack sudo[84313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 25 23:59:54 devstack sudo[84313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:54 devstack sudo[84313]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:54 devstack sudo[84316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:54 devstack sudo[84316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:54 devstack sudo[84316]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:54 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:54 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 25 23:59:54 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:55 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:55 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:55 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 25 23:59:55 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 25 23:59:55 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 25 23:59:55 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Aug 25 23:59:55 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 25 23:59:55 devstack cinder-volume[83472]: INFO cinder.volume.manager [None req-7ce9b73c-0d30-462f-a20a-9f19e2a5d056 None None] Driver post RPC initialization completed successfully. Aug 25 23:59:57 devstack cinder-volume[83291]: DEBUG dbcounter [-] [83291] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83291) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:00:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:SELECT=4 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:00:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:00:36 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager._thread_info {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:00:36 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread count: 6 {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:00:36 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread info: [<_MainThread(MainThread, started 137662699831424)>, , , , , ] {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:01:36 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 00:01:36 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:01:36 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:01:36 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:01:36 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:01:36 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:01:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:01:36 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 00:01:36 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:01:37 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:01:37 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:01:37 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:01:37 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG cinder.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Notifying Schedulers of capabilities ... {{(pid=83472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager._thread_info {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread count: 6 {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:01:37 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread info: [<_MainThread(MainThread, started 137662699831424)>, , , , , ] {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:02:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:SELECT=1 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:02:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:UPDATE=1 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:02:36 devstack sudo[91264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 00:02:36 devstack sudo[91264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:02:36 devstack sudo[91264]: pam_unix(sudo:session): session closed for user root Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:02:36 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:02:36 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:02:36 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:02:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:02:36 devstack sudo[91286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 00:02:37 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:02:37 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:02:37 devstack sudo[91303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:02:37 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:02:37 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG cinder.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Notifying Schedulers of capabilities ... {{(pid=83472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager._thread_info {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread count: 6 {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:02:37 devstack cinder-volume[83472]: DEBUG cinder.volume.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] thread info: [<_MainThread(MainThread, started 137662699831424)>, , , , , ] {{(pid=83472) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_service.periodic_task [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83472) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG cinder.volume.drivers.lvm [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Updating volume stats {{(pid=83472) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:03:36 devstack sudo[92696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 00:03:36 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:03:36 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:03:36 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:03:36 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:03:36 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:03:36 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:03:36 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 00:03:36 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:03:37 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Aug 26 00:03:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:03:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:03:37 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 00:03:37 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:03:37 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Aug 26 00:03:37 devstack cinder-volume[83472]: DEBUG oslo_concurrency.processutils [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83472) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:03:37 devstack cinder-volume[83472]: DEBUG cinder.manager [None req-f59b84e8-7881-4a80-b8e7-620ed0d4d714 None None] Notifying Schedulers of capabilities ... {{(pid=83472) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:04:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:SELECT=1 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:04:05 devstack cinder-volume[83472]: DEBUG dbcounter [-] [83472] Writing DB stats cinder:UPDATE=1 {{(pid=83472) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:04:19 devstack cinder-volume[83291]: INFO oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Caught SIGTERM, stopping children Aug 26 00:04:19 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Acquiring lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:19 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Acquired lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:19 devstack cinder-volume[83291]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Releasing lock "singleton_lock" {{(pid=83291) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:19 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Stop services. {{(pid=83291) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 00:04:19 devstack cinder-volume[83291]: DEBUG oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Killing children. {{(pid=83291) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 00:04:19 devstack cinder-volume[83291]: INFO oslo_service.backend._eventlet.service [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Waiting on 1 children to exit Aug 26 00:04:24 devstack cinder-volume[83472]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 26 00:04:24 devstack cinder-volume[93631]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 00:04:24 devstack cinder-volume[93631]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 00:04:24 devstack cinder-volume[93631]: we strongly recommend against using it for new projects. Aug 26 00:04:24 devstack cinder-volume[93631]: If you are already using Eventlet, we recommend migrating to a different Aug 26 00:04:24 devstack cinder-volume[93631]: framework. For more detail see Aug 26 00:04:24 devstack cinder-volume[93631]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 00:04:24 devstack cinder-volume[93631]: import eventlet # noqa Aug 26 00:04:26 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:26 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:26 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:27 devstack cinder-volume[93631]: INFO dbcounter [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Registered counter for database cinder Aug 26 00:04:27 devstack cinder-volume[93631]: DEBUG oslo_db.sqlalchemy.engines [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:27 devstack cinder-volume[93631]: DEBUG dbcounter [-] [93631] Writer thread running {{(pid=93631) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 00:04:27 devstack cinder-volume[93631]: INFO cinder.rpc [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 00:04:27 devstack cinder-volume[93631]: INFO cinder.rpc [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 00:04:27 devstack cinder-volume[93631]: DEBUG oslo_db.sqlalchemy.engines [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:28 devstack cinder-volume[93631]: INFO cinder.volume.manager [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Determined volume DB was empty at startup. Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG cinder.volume.manager [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93631) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 00:04:28 devstack cinder-volume[93631]: INFO cinder.volume.manager [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 00:04:28 devstack cinder-volume[93631]: WARNING stevedore.named [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 00:04:28 devstack cinder-volume[93631]: WARNING castellan.key_manager [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 00:04:28 devstack cinder-volume[93631]: WARNING cinder.keymgr.conf_key_mgr [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 00:04:28 devstack cinder-volume[93631]: INFO cinder.volume.manager [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_db.sqlalchemy.engines [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93631) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:28 devstack cinder-volume[93631]: INFO oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Starting 1 workers Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Started child 93849 {{(pid=93631) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Full set of CONF: {{(pid=93631) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] ******************************************************************************** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Configuration options gathered from: {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 00:04:28 devstack cinder-volume[93849]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] ================================================================================ {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] allow_availability_zone_fallback = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] allow_compression_on_image_upload = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] allowed_direct_url_schemes = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] api_rate_limit = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] auth_strategy = keystone {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_availability_zone = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_host = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_stats_polling_interval = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backup_api_class = cinder.backup.api.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backup_name_template = backup-%s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backup_use_same_host = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backup_use_temp_snapshot = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] chap_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] chap_username = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_internal_tenant_project_id = 2623d595f85f432684b15e3185fc6739 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_internal_tenant_user_id = 7040a9b16c96469dac34c0e0bada44f9 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cluster = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] compression_format = gzip {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] compute_api_class = cinder.compute.nova.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] config_dir = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] config_source = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] control_exchange = openstack {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] debug = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] default_availability_zone = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] default_group_type = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] default_volume_type = QuobyteHD {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] disk_geometry = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_client_cert = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_client_cert_key = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_data_namespace = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_ssl_cert_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_ssl_cert_verify = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] driver_use_ssl = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] enable_new_services = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] enable_unsupported_driver = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] enabled_backends = ['QuobyteHD'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] enforce_multipath_for_image_xfer = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] filter_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_api_insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_api_ssl_compression = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_ca_certificates_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_catalog_info = image:glance:publicURL {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_num_retries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance_request_timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] goodness_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] graceful_shutdown_timeout = 5 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] group_api_class = cinder.group.api.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] host = devstack {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_compress_on_upload = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_conversion_address_space_limit = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_conversion_cpu_limit = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_conversion_disable = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_upload_use_cinder_backend = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_upload_use_internal_tenant = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_volume_cache_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_volume_cache_max_count = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] image_volume_cache_max_size_gb = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] init_host_max_objects_retrieval = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] instance_format = [instance: %(uuid)s] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iscsi_target_flags = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iscsi_write_cache = on {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iser_helper = tgtadm {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iser_ip_address = 192.168.122.77 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iser_port = 3260 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_color = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_config_append = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_dir = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_options = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_rotate_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_rotate_interval_type = days {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] log_rotation_type = none {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] max_age = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] max_logfile_count = 30 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] max_logfile_size_mb = 200 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] max_over_subscription_ratio = 20.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93849]: INFO cinder.volume.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.remotefs [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93849) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] message_reap_interval = 86400 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] message_ttl = 2592000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] migration_create_volume_timeout_secs = 300 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] monkey_patch = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] monkey_patch_modules = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] my_ip = 192.168.122.77 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] no_snapshot_gb_quota = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] num_iser_scan_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] num_shell_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] num_volume_device_scan_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] nvmeof_conn_info_version = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] nvmet_ns_id = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] nvmet_port_id = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_max_limit = 1000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_ext_list = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_listen = 0.0.0.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_listen_port = 8776 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_use_ssl = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] osapi_volume_workers = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] per_volume_size_limit = -1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] periodic_fuzzy_delay = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] periodic_interval = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] project_id_regex = [0-9a-f\-]+ {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] public_endpoint = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] publish_errors = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_backup_gigabytes = 1000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_backups = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_gigabytes = 1000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_groups = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_snapshots = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] quota_volumes = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] rate_limit_burst = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] rate_limit_except_level = CRITICAL {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] rate_limit_interval = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] reinit_driver_count = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] replication_device = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] report_discard_supported = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] report_interval = 120 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] reservation_clean_interval = 86400 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] reservation_expire = 86400 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] reserved_image_namespaces = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] reserved_percentage = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] rpc_response_timeout = 120 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] run_external_periodic_tasks = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] scst_target_driver = iscsi {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] scst_target_iqn_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_down_time = 720 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] shell_completion = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] snapshot_name_template = snapshot-%s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] split_loggers = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] state_path = /opt/stack/data/cinder {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] storage_availability_zone = nova {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] storage_protocol = iSCSI {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] syslog_log_facility = LOG_USER {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_helper = lioadm {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_ip_address = 192.168.122.77 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_port = 3260 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_protocol = iscsi {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] target_secondary_ip_addresses = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] trace_flags = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] transfer_api_class = cinder.transfer.api.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] transport_url = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] until_refresh = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_chap_auth = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_default_quota_class = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_journal = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_json = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_multipath_for_image_xfer = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_stderr = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] use_syslog = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] verify_glance_signatures = enabled {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_api_class = cinder.volume.api.API {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_backend_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_clear = zero {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_clear_ionice = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_clear_size = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_copy_bps_limit = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_dd_blocksize = 1M {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_name_template = volume-%s {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_service_inithost_offload = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volume_usage_audit_period = month {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] zoning_mode = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_concurrency.disable_process_locking = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.auth_section = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.auth_type = password {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.auth_version = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.cache = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.delay_auth_decision = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.http_connect_timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.include_service_catalog = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.interface = public {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcache_username = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.region_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.service_token_roles_required = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.service_type = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.token_cache_time = 300 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.backend = dogpile.cache.null {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.backend_argument = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.backend_expiration_time = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.config_prefix = cache.oslo {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.debug_cache_backend = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.enable_retry_client = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.enable_socket_keepalive = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.expiration_time = 600 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.hashclient_retry_attempts = 2 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_dead_retry = 300 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_pool_maxsize = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_sasl_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.proxies = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.redis_db = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.redis_sentinel_service_name = mymaster {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93849) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 00:04:28 devstack cinder-volume[93849]: WARNING cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 00:04:28 devstack cinder-volume[93849]: WARNING cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.redis_server = localhost:6379 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.retry_attempts = 2 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.retry_delay = 0.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.socket_keepalive_count = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.socket_keepalive_idle = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.socket_keepalive_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.socket_timeout = 1.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.tls_allowed_ciphers = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Running cmd (subprocess): mount.quobyte {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.tls_cafile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.tls_certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.tls_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.tls_keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cache.username = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] coordination.backend_url = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.asyncio_connection = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.asyncio_slave_connection = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.backend = sqlalchemy {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.connection = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.connection_debug = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.connection_parameters = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.connection_recycle_time = 3600 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.connection_trace = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.db_inc_retry_interval = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.db_max_retries = 20 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.db_max_retry_interval = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.db_retry_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.max_overflow = 50 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.max_pool_size = 5 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.max_retries = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.mysql_wsrep_sync_wait = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.pool_timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.retry_interval = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.slave_connection = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.sqlite_synchronous = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.synchronous_reader = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] database.use_db_reconnect = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.connection_string = messaging:// {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.es_doc_type = notification {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.es_scroll_size = 10000 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.es_scroll_time = 2m {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.filter_error_trace = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.hmac_keys = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.sentinel_service_name = mymaster {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.socket_timeout = 0.1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.trace_requests = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler.trace_sqlalchemy = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler_jaeger.process_tags = {} {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler_jaeger.service_name_prefix = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] profiler_otlp.service_name_prefix = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.enforce_new_defaults = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.policy_default_rule = default {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.policy_file = policy.yaml {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_policy.remote_timeout = 60.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.group = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.helper_command = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] privsep_osbrick.user = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.group = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.helper_command = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] cinder_sys_admin.user = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.auth_section = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.auth_type = password {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.cafile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.collect_timing = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.send_service_user_token = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.split_loggers = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] service_user.timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.auth_section = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.auth_type = password {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.collect_timing = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.region_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.split_loggers = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] glance.timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.backend_availability_zone = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.chap_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.chap_username = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.disk_geometry = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_client_cert = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_client_cert_key = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_data_namespace = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.driver_use_ssl = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.enable_unsupported_driver = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.extra_capabilities = {} {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.filter_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.goodness_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iscsi_target_flags = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iscsi_write_cache = on {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iser_helper = tgtadm {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iser_port = 3260 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_host = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_login = admin {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_mount_options = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_private_key = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_share_path = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_ssh_port = 22 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.num_shell_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.nvmet_port_id = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_client_cfg = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.quobyte_volume_url = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.replication_device = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.report_discard_supported = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.reserved_percentage = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.scst_target_driver = iscsi {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.scst_target_iqn_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.storage_protocol = iSCSI {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_helper = tgtadm {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_port = 3260 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_protocol = iscsi {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.trace_flags = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.unique_fqdn_network = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.use_chap_auth = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_backend_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_clear = zero {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_clear_ionice = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_clear_size = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_reports.file_event_handler = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_reports.log_dir = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.backend_availability_zone = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.backend_host = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.chap_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.chap_username = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.chiscsi_conf = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.disk_geometry = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_client_cert = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_client_cert_key = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_data_namespace = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.driver_use_ssl = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.extra_capabilities = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.filter_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.goodness_function = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iscsi_target_flags = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iscsi_write_cache = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iser_helper = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iser_ip_address = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iser_port = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.iser_target_prefix = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_host = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_login = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] CMD "mount.quobyte" returned: 1 in 0.147s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_mount_options = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_password = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_private_key = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_share_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_ssh_port = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=93849) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.num_shell_tries = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: INFO cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 ... Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 -c /etc/quobyte/client-cinder.cfg {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nvmet_ns_id = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.nvmet_port_id = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.replication_device = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.report_discard_supported = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.reserved_percentage = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.scst_target_driver = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.storage_protocol = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_helper = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_ip_address = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_port = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_prefix = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_protocol = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.trace_flags = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.unique_fqdn_network = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.use_chap_auth = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_clear = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_clear_ionice = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_clear_size = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] QuobyteHD.volumes_dir = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 -c /etc/quobyte/client-cinder.cfg Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.ssl_version = {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_notifications.driver = [] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_notifications.retry = -1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] oslo_messaging_notifications.transport_url = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] key_manager.fixed_key = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.barbican_api_version = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.barbican_endpoint = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.barbican_endpoint_type = public {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.barbican_region_name = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.cafile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.collect_timing = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.number_of_retries = 60 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.retry_delay = 1 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.send_service_user_token = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.split_loggers = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.verify_ssl = True {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican.verify_ssl_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.auth_section = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.auth_type = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.cafile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.certfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.collect_timing = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.insecure = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.keyfile = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.split_loggers = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] barbican_service_user.timeout = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.approle_role_id = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.approle_secret_id = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.auth_method = approle {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.auth_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.kv_mountpoint = secret {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.kv_path = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.kv_version = 2 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.namespace = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.root_token_id = **** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.ssl_ca_crt_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.timeout = 60.0 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.token_file = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.token_role = None {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.use_ssl = False {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:28 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] ******************************************************************************** {{(pid=93631) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 00:04:28 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:28 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.358s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:28 devstack cinder-volume[93849]: INFO cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 succeeded Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=93849) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.370s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:29 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:29 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:29 devstack cinder-volume[83472]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Acquiring lock "singleton_lock" {{(pid=83472) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:29 devstack cinder-volume[83472]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Acquired lock "singleton_lock" {{(pid=83472) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:29 devstack cinder-volume[83472]: DEBUG oslo_concurrency.lockutils [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Releasing lock "singleton_lock" {{(pid=83472) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:29 devstack cinder-volume[83472]: WARNING amqp [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 00:04:29 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:29 devstack cinder-volume[83472]: WARNING amqp [None req-04115da8-060b-495f-a78e-38b6fbd7765a None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.245s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.volume.driver [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.driver [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9060897827148, 'free_capacity_gb': 1774.9060897827148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93849) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_db.sqlalchemy.engines [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93849) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG dbcounter [-] [93849] Writer thread running {{(pid=93849) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.db.api [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Building query based on filter {{(pid=93849) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.image.image_utils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93849) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.keymgr.migration [None req-eda0d18e-dde6-435f-9f33-f720fa32af6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=93849) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=93849) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:29 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:29 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:29 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.231s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Notifying Schedulers of capabilities ... {{(pid=93849) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.volume.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Driver initialization completed successfully. Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Initiating service 3 cleanup Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Service 3 cleanup completed. Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.service [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Creating RPC server for service cinder-volume {{(pid=93849) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.service [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93849) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 00:04:29 devstack cinder-volume[93849]: INFO cinder.volume.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=93849) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=93849) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:29 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:29 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:29 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:30 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:30 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.347s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:30 devstack cinder-volume[93849]: INFO cinder.volume.manager [None req-5e02534f-9f25-4623-b342-5c9a727610c2 None None] Driver post RPC initialization completed successfully. Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=93849) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG cinder.volume.drivers.quobyte [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=93849) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93849) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:34 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:34 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:34 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG oslo_concurrency.processutils [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.248s {{(pid=93849) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:34 devstack cinder-volume[93849]: DEBUG cinder.manager [None req-39a828f3-7a20-4ec3-8658-bd7a8d510336 None None] Notifying Schedulers of capabilities ... {{(pid=93849) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:04:35 devstack cinder-volume[93631]: INFO oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Caught SIGTERM, stopping children Aug 26 00:04:35 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Acquiring lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:35 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Acquired lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:35 devstack cinder-volume[93631]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Releasing lock "singleton_lock" {{(pid=93631) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:35 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Stop services. {{(pid=93631) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 00:04:35 devstack cinder-volume[93631]: DEBUG oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Killing children. {{(pid=93631) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 00:04:35 devstack cinder-volume[93631]: INFO oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Waiting on 1 children to exit Aug 26 00:04:38 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Acquiring lock "singleton_lock" {{(pid=93849) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:38 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Acquired lock "singleton_lock" {{(pid=93849) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:38 devstack cinder-volume[93849]: DEBUG oslo_concurrency.lockutils [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Releasing lock "singleton_lock" {{(pid=93849) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:38 devstack cinder-volume[93849]: WARNING amqp [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 00:04:38 devstack cinder-volume[93849]: WARNING amqp [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 00:04:38 devstack cinder-volume[93631]: INFO oslo_service.backend._eventlet.service [None req-55fa1e9c-1692-498b-a671-42355a1dfc6d None None] Child 93849 exited with status 0 Aug 26 00:04:38 devstack cinder-volume[94140]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 00:04:38 devstack cinder-volume[94140]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 00:04:38 devstack cinder-volume[94140]: we strongly recommend against using it for new projects. Aug 26 00:04:38 devstack cinder-volume[94140]: If you are already using Eventlet, we recommend migrating to a different Aug 26 00:04:38 devstack cinder-volume[94140]: framework. For more detail see Aug 26 00:04:38 devstack cinder-volume[94140]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 00:04:38 devstack cinder-volume[94140]: import eventlet # noqa Aug 26 00:04:41 devstack cinder-volume[94140]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 00:04:41 devstack cinder-volume[94140]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 00:04:41 devstack cinder-volume[94140]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 00:04:42 devstack cinder-volume[94140]: INFO dbcounter [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Registered counter for database cinder Aug 26 00:04:42 devstack cinder-volume[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:42 devstack cinder-volume[94140]: DEBUG dbcounter [-] [94140] Writer thread running {{(pid=94140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 00:04:42 devstack cinder-volume[94140]: INFO cinder.rpc [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 00:04:42 devstack cinder-volume[94140]: INFO cinder.rpc [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 00:04:42 devstack cinder-volume[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:42 devstack cinder-volume[94140]: INFO cinder.volume.manager [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Determined volume DB was empty at startup. Aug 26 00:04:42 devstack cinder-volume[94140]: DEBUG cinder.volume.manager [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94140) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 00:04:42 devstack cinder-volume[94140]: WARNING stevedore.named [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 00:04:42 devstack cinder-volume[94140]: WARNING castellan.key_manager [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 00:04:42 devstack cinder-volume[94140]: WARNING cinder.keymgr.conf_key_mgr [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 00:04:42 devstack cinder-volume[94140]: INFO cinder.volume.manager [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_db.sqlalchemy.engines [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:43 devstack cinder-volume[94140]: INFO oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Starting 1 workers Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Started child 94433 {{(pid=94140) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Full set of CONF: {{(pid=94140) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] ******************************************************************************** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] Configuration options gathered from: {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] ================================================================================ {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] allow_availability_zone_fallback = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] allow_compression_on_image_upload = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94433]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] allowed_direct_url_schemes = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] api_rate_limit = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] auth_strategy = keystone {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_availability_zone = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_host = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_stats_polling_interval = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backup_api_class = cinder.backup.api.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backup_name_template = backup-%s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backup_use_same_host = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backup_use_temp_snapshot = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] chap_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] chap_username = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_internal_tenant_project_id = 2623d595f85f432684b15e3185fc6739 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_internal_tenant_user_id = 7040a9b16c96469dac34c0e0bada44f9 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cluster = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] compression_format = gzip {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] compute_api_class = cinder.compute.nova.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] config_dir = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] config_source = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] control_exchange = openstack {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] debug = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] default_availability_zone = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] default_group_type = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] default_volume_type = QuobyteHD {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] disk_geometry = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_client_cert = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_client_cert_key = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_data_namespace = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_ssl_cert_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_ssl_cert_verify = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] driver_use_ssl = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] enable_new_services = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] enable_unsupported_driver = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] enabled_backends = ['QuobyteHD'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] enforce_multipath_for_image_xfer = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] filter_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_api_insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_api_servers = ['http://192.168.122.77/image'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_api_ssl_compression = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_ca_certificates_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_catalog_info = image:glance:publicURL {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_num_retries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance_request_timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] goodness_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] graceful_shutdown_timeout = 5 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] group_api_class = cinder.group.api.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] host = devstack {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_compress_on_upload = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_conversion_address_space_limit = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_conversion_cpu_limit = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_conversion_disable = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_upload_use_cinder_backend = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_upload_use_internal_tenant = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_volume_cache_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_volume_cache_max_count = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] image_volume_cache_max_size_gb = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] init_host_max_objects_retrieval = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] instance_format = [instance: %(uuid)s] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iscsi_target_flags = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iscsi_write_cache = on {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iser_helper = tgtadm {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iser_ip_address = 192.168.122.77 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iser_port = 3260 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_color = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_config_append = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_dir = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_options = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_rotate_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_rotate_interval_type = days {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] log_rotation_type = none {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] max_age = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] max_logfile_count = 30 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] max_logfile_size_mb = 200 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] max_over_subscription_ratio = 20.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] message_reap_interval = 86400 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] message_ttl = 2592000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] migration_create_volume_timeout_secs = 300 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] monkey_patch = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] monkey_patch_modules = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] my_ip = 192.168.122.77 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] no_snapshot_gb_quota = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] num_iser_scan_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] num_shell_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] num_volume_device_scan_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] nvmeof_conn_info_version = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] nvmet_ns_id = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] nvmet_port_id = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_max_limit = 1000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_ext_list = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_listen_port = 8776 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_use_ssl = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] osapi_volume_workers = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] per_volume_size_limit = -1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] periodic_fuzzy_delay = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] periodic_interval = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] public_endpoint = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] publish_errors = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_backup_gigabytes = 1000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_backups = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_gigabytes = 1000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_groups = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_snapshots = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] quota_volumes = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] rate_limit_burst = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] rate_limit_except_level = CRITICAL {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] rate_limit_interval = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] reinit_driver_count = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] replication_device = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] report_discard_supported = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] report_interval = 120 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] reservation_clean_interval = 86400 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] reservation_expire = 86400 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] reserved_image_namespaces = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] reserved_percentage = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] rpc_response_timeout = 120 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94433) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] run_external_periodic_tasks = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] scst_target_driver = iscsi {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] scst_target_iqn_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_down_time = 720 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] shell_completion = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] snapshot_name_template = snapshot-%s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] split_loggers = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] state_path = /opt/stack/data/cinder {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] storage_availability_zone = nova {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] storage_protocol = iSCSI {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] syslog_log_facility = LOG_USER {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_helper = lioadm {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_ip_address = 192.168.122.77 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_port = 3260 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_protocol = iscsi {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] target_secondary_ip_addresses = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] trace_flags = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] transport_url = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] until_refresh = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_chap_auth = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_default_quota_class = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_journal = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_json = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_multipath_for_image_xfer = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_stderr = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] use_syslog = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] verify_glance_signatures = enabled {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_api_class = cinder.volume.api.API {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_backend_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_clear = zero {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_clear_ionice = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_clear_size = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_copy_bps_limit = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_dd_blocksize = 1M {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_name_template = volume-%s {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_service_inithost_offload = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volume_usage_audit_period = month {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] zoning_mode = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_concurrency.disable_process_locking = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.auth_section = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.auth_type = password {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.auth_version = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.cache = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.include_service_catalog = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.interface = public {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcache_username = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.region_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.service_type = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.77/identity {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.backend = dogpile.cache.null {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.backend_argument = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.backend_expiration_time = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.config_prefix = cache.oslo {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.debug_cache_backend = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.enable_retry_client = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.enable_socket_keepalive = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.expiration_time = 600 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.hashclient_retry_attempts = 2 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_dead_retry = 300 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_pool_maxsize = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_sasl_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.proxies = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.redis_db = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.redis_server = localhost:6379 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.retry_attempts = 2 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.retry_delay = 0.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.socket_keepalive_count = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.socket_keepalive_idle = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.socket_keepalive_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.socket_timeout = 1.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.tls_allowed_ciphers = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.tls_cafile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.tls_certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.tls_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.tls_keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cache.username = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] coordination.backend_url = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.asyncio_connection = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.asyncio_slave_connection = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.backend = sqlalchemy {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.connection = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.connection_debug = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.connection_parameters = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.connection_recycle_time = 3600 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.connection_trace = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.db_inc_retry_interval = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.db_max_retries = 20 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.db_max_retry_interval = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.db_retry_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.max_overflow = 50 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.max_pool_size = 5 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.max_retries = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.mysql_wsrep_sync_wait = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.pool_timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.retry_interval = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.slave_connection = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.sqlite_synchronous = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.synchronous_reader = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] database.use_db_reconnect = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.connection_string = messaging:// {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.es_doc_type = notification {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.es_scroll_size = 10000 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.es_scroll_time = 2m {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.filter_error_trace = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.hmac_keys = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.sentinel_service_name = mymaster {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.socket_timeout = 0.1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.trace_requests = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler.trace_sqlalchemy = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler_jaeger.process_tags = {} {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler_jaeger.service_name_prefix = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] profiler_otlp.service_name_prefix = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.enforce_new_defaults = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.policy_default_rule = default {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.policy_file = policy.yaml {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.group = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.helper_command = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] privsep_osbrick.user = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.group = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.helper_command = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] cinder_sys_admin.user = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.auth_section = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.auth_type = password {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.cafile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.collect_timing = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.send_service_user_token = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.split_loggers = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] service_user.timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.auth_section = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.auth_type = password {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.collect_timing = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.region_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.split_loggers = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] glance.timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.backend_availability_zone = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.chap_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.chap_username = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.disk_geometry = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_client_cert = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_client_cert_key = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_data_namespace = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.driver_use_ssl = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.extra_capabilities = {} {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.filter_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.goodness_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iscsi_target_flags = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iscsi_write_cache = on {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iser_helper = tgtadm {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iser_ip_address = 192.168.122.77 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iser_port = 3260 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_host = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_login = admin {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_mount_options = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_private_key = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_share_path = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.num_shell_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94433) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 00:04:43 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.quobyte_volume_url = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.replication_device = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.report_discard_supported = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.reserved_percentage = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Running cmd (subprocess): mount.quobyte {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_helper = tgtadm {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_ip_address = 192.168.122.77 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_port = 3260 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_protocol = iscsi {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.trace_flags = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.unique_fqdn_network = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.use_chap_auth = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_backend_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_clear = zero {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_clear_ionice = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_clear_size = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_reports.file_event_handler = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_reports.log_dir = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.backend_availability_zone = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.backend_host = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.chap_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.chap_username = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.chiscsi_conf = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.disk_geometry = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_client_cert = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_data_namespace = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.driver_use_ssl = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.extra_capabilities = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.filter_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.goodness_function = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iser_helper = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iser_ip_address = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iser_port = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.iser_target_prefix = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_host = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_login = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_mount_options = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_password = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_private_key = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_share_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_ssh_port = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.num_shell_tries = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.nvmet_port_id = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.replication_device = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.report_discard_supported = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.reserved_percentage = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.scst_target_driver = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.storage_protocol = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_helper = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_ip_address = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_port = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_prefix = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_protocol = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.trace_flags = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.use_chap_auth = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_clear = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_clear_size = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack quobyte-client[94442]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] QuobyteHD.volumes_dir = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack quobyte-client[94442]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_notifications.driver = [] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_notifications.retry = -1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] key_manager.fixed_key = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.barbican_api_version = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.barbican_endpoint = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.barbican_endpoint_type = public {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.barbican_region_name = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.cafile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.collect_timing = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.number_of_retries = 60 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.retry_delay = 1 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.send_service_user_token = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.split_loggers = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.verify_ssl = True {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican.verify_ssl_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.auth_section = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.auth_type = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.cafile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.certfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.collect_timing = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.insecure = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] CMD "mount.quobyte" returned: 1 in 0.098s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.keyfile = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.split_loggers = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] barbican_service_user.timeout = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.approle_role_id = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.approle_secret_id = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.auth_method = approle {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.auth_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.kv_mountpoint = secret {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.kv_path = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.kv_version = 2 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.namespace = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.root_token_id = **** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.ssl_ca_crt_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.timeout = 60.0 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.token_file = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.token_role = None {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.use_ssl = False {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 00:04:43 devstack cinder-volume[94140]: DEBUG oslo_service.backend._eventlet.service [None req-057ce453-dc95-40dd-be9d-f6b78f9f6149 None None] ******************************************************************************** {{(pid=94140) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:43 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:43 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:43 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:43 devstack cinder-volume[94433]: INFO cinder.volume.driver [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.driver [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.904396057129, 'free_capacity_gb': 1774.904396057129, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94433) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_db.sqlalchemy.engines [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94433) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writer thread running {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.db.api [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Building query based on filter {{(pid=94433) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94433) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:43 devstack cinder-volume[94433]: INFO cinder.keymgr.migration [None req-e8d889e8-b166-4c21-9bfd-4d068d9fe8e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 00:04:43 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:43 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:44 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:04:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Driver initialization completed successfully. Aug 26 00:04:44 devstack cinder-volume[94433]: INFO cinder.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Initiating service 3 cleanup Aug 26 00:04:44 devstack cinder-volume[94433]: INFO cinder.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Service 3 cleanup completed. Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG cinder.service [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Creating RPC server for service cinder-volume {{(pid=94433) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG cinder.service [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94433) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 00:04:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:04:44 devstack sudo[94468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:04:44 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:04:44 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root Aug 26 00:04:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.241s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:04:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d565578d-4efd-48aa-9cee-aa75290b99b3 None None] Driver post RPC initialization completed successfully. Aug 26 00:04:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:04:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 6 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:04:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:04:53 devstack cinder-volume[94140]: DEBUG dbcounter [-] [94140] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:04:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:04:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Flow 'volume_create_manager' (416a9f31-4141-4f74-acb6-d055297a54c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6712fdfc-d219-4789-95df-a4b368a97bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6712fdfc-d219-4789-95df-a4b368a97bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1902107739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1fa9c3-1ecb-4a3f-beab-b8145dc17190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c215be298bd04acd959b44c865101812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:42Z,use_quota=True,user_id='fed22f8e604d447a9315a5fa0f2ea46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823c05ec-e1a9-40c8-95a0-d4bf3da39316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823c05ec-e1a9-40c8-95a0-d4bf3da39316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d72da43-db7c-4476-a0b3-9da43273853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d72da43-db7c-4476-a0b3-9da43273853a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1fa9c3-1ecb-4a3f-beab-b8145dc17190', 'volume_name': 'volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068a8216-dafe-4b9c-946f-6b8402a429e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068a8216-dafe-4b9c-946f-6b8402a429e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6505723f-1e93-4b8d-a6d7-94fca1159e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:41 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Volume 6d1fa9c3-1ecb-4a3f-beab-b8145dc17190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190', 'volume_size': 1} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1902107739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1fa9c3-1ecb-4a3f-beab-b8145dc17190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c215be298bd04acd959b44c865101812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:42Z,use_quota=True,user_id='fed22f8e604d447a9315a5fa0f2ea46f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Creating volume 6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:05:41 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:05:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:42 devstack sudo[95043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 1073741824 Aug 26 00:05:42 devstack sudo[95043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Flow 'volume_create_manager' (df01b85c-ef94-4982-865f-6bb9e85ca438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39a5f2c-f252-459f-b650-f52539e5a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39a5f2c-f252-459f-b650-f52539e5a54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-924378542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c82f33-a3f3-4a4d-9a30-9aeb41ecb978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b35dfab3ac54d1eb48c5f65ca2f6678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:42Z,use_quota=True,user_id='1d2a21467d9449629e9228eaa31cce03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8d9bf5-58ba-4609-be5d-e7ac55285859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c8d9bf5-58ba-4609-be5d-e7ac55285859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ee4f16-23d8-4537-858b-33b41d9fa0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58ee4f16-23d8-4537-858b-33b41d9fa0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c82f33-a3f3-4a4d-9a30-9aeb41ecb978', 'volume_name': 'volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c58565a-377a-40b1-bcfd-aa25a91f01c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c58565a-377a-40b1-bcfd-aa25a91f01c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfef704b-e416-49f9-9a13-421dc260e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:42 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Volume 60c82f33-a3f3-4a4d-9a30-9aeb41ecb978: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978', 'volume_size': 1} Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:42 devstack sudo[95043]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 1073741824" returned: 0 in 1.004s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:43 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 Aug 26 00:05:43 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:43 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" returned: 0 in 0.789s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-924378542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c82f33-a3f3-4a4d-9a30-9aeb41ecb978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b35dfab3ac54d1eb48c5f65ca2f6678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:42Z,use_quota=True,user_id='1d2a21467d9449629e9228eaa31cce03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Creating volume 60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:05:43 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:43 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 1073741824 Aug 26 00:05:43 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6505723f-1e93-4b8d-a6d7-94fca1159e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e958c1-3e5e-43c3-8ce1-940e1509d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:44 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Volume volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 (6d1fa9c3-1ecb-4a3f-beab-b8145dc17190): created successfully Aug 26 00:05:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e958c1-3e5e-43c3-8ce1-940e1509d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Flow 'volume_create_manager' (416a9f31-4141-4f74-acb6-d055297a54c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-5207430c-1f25-4733-9632-3584c45eb19a req-2c9f3177-8377-4cb0-850d-a181eca37806 tempest-VolumesSnapshotsTestJSON-940150563 None] Created volume successfully. Aug 26 00:05:45 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 1073741824" returned: 0 in 1.121s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:45 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 Aug 26 00:05:45 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:45 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" returned: 0 in 0.616s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.020s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfef704b-e416-49f9-9a13-421dc260e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0187675d-5bdc-42f5-896e-df8617ac4494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Creating offline snapshot 02381f1d-7e06-429c-a486-0a0a3545adae of volume 6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:05:45 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp68gfad3x/privsep.sock'] Aug 26 00:05:46 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Volume volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 (60c82f33-a3f3-4a4d-9a30-9aeb41ecb978): created successfully Aug 26 00:05:46 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp68gfad3x/privsep.sock Aug 26 00:05:46 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0187675d-5bdc-42f5-896e-df8617ac4494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Flow 'volume_create_manager' (df01b85c-ef94-4982-865f-6bb9e85ca438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2f5f2a0b-0618-4f1c-8ccb-7702dc53a536 tempest-DeleteServersTestJSON-1152427846 None] Created volume successfully. Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:46 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:05:46 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:47 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.633s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:05:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:05:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 7 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:05:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 00:05:48 devstack cinder-volume[94433]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 00:05:49 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:49 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Spawned new privsep daemon via rootwrap Aug 26 00:05:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Accepted privsep connection to /tmp/tmp68gfad3x/privsep.sock {{(pid=94433) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 00:05:49 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 00:05:49 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 00:05:49 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 00:05:49 devstack cinder-volume[94433]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95536 Aug 26 00:05:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba61ef98-c2b5-4913-b5fd-7f3b70ba2e60]: (2,) {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8132325-7752-4dcc-a3c8-c7d64a0c2601]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:49 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 Aug 26 00:05:49 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:50 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" returned: 0 in 0.894s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:50 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae 1G Aug 26 00:05:50 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Flow 'volume_create_manager' (87804560-4657-4891-a7db-bad3107e0850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079e5456-bc17-41e6-818f-960daf873ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (079e5456-bc17-41e6-818f-960daf873ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1571962598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e2a01-6e37-4f10-882c-9d563539712b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8528e5c93b49d1a888db97e026d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:51Z,use_quota=True,user_id='ba16f1ac05d24cd4b2252d7798091c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eb10eb-ecae-4d37-94be-0903d9a098ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:51 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49eb10eb-ecae-4d37-94be-0903d9a098ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c0eb89-2cb0-478c-abe5-184f3eb27b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c0eb89-2cb0-478c-abe5-184f3eb27b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79e2a01-6e37-4f10-882c-9d563539712b', 'volume_name': 'volume-b79e2a01-6e37-4f10-882c-9d563539712b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead02198-a0c3-4bc6-b8c3-72b31e3fa1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead02198-a0c3-4bc6-b8c3-72b31e3fa1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b768a0b-529a-47d3-8f0e-8dfc2877066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:51 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Volume b79e2a01-6e37-4f10-882c-9d563539712b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79e2a01-6e37-4f10-882c-9d563539712b', 'volume_size': 1} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae 1G" returned: 0 in 1.210s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:51 devstack sudo[95574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae Aug 26 00:05:51 devstack sudo[95574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:51 devstack sudo[95574]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae" returned: 0 in 0.465s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:51 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae is being set with open permissions: ugo+rw Aug 26 00:05:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:51 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae Aug 26 00:05:51 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:52 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae" returned: 0 in 0.523s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:52 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info Aug 26 00:05:52 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:52 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info" returned: 0 in 0.417s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:52 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info is being set with open permissions: ugo+rw Aug 26 00:05:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:52 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info Aug 26 00:05:52 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:52 devstack cinder-volume[94433]: WARNING py.warnings [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 26 00:05:52 devstack cinder-volume[94433]: .first() Aug 26 00:05:52 devstack cinder-volume[94433]: Aug 26 00:05:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:53 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.info" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.342s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1571962598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79e2a01-6e37-4f10-882c-9d563539712b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e8528e5c93b49d1a888db97e026d386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:05:51Z,use_quota=True,user_id='ba16f1ac05d24cd4b2252d7798091c4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Creating volume b79e2a01-6e37-4f10-882c-9d563539712b {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:05:53 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:53 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b 1073741824 Aug 26 00:05:53 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-fe23b590-81be-448f-89a4-2551f4c59663 req-daa80718-2455-425c-adee-332e842d5592 tempest-VolumesSnapshotsTestJSON-940150563 None] Create snapshot completed successfully Aug 26 00:05:53 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b 1073741824" returned: 0 in 0.607s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:53 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b Aug 26 00:05:53 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:54 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.160s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b768a0b-529a-47d3-8f0e-8dfc2877066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79e2a01-6e37-4f10-882c-9d563539712b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f0c264-d929-4371-8585-c104daa20fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:54 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Volume volume-b79e2a01-6e37-4f10-882c-9d563539712b (b79e2a01-6e37-4f10-882c-9d563539712b): created successfully Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f0c264-d929-4371-8585-c104daa20fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Flow 'volume_create_manager' (87804560-4657-4891-a7db-bad3107e0850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:05:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d93a2817-e91a-4b9e-9085-e0f96cc429d2 tempest-VolumesAdminNegativeTest-2090365712 None] Created volume successfully. Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b26955fc-89ba-4f26-9e23-950d6e18f9d9', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "cinder-02381f1d-7e06-429c-a486-0a0a3545adae-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-78b8e7ba-34ef-456b-a79b-025e83d07b3b req-740de568-6b89-462e-abfa-56105c52df9d tempest-DeleteServersTestJSON-1152427846 None] attachment_update completed successfully. Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-02381f1d-7e06-429c-a486-0a0a3545adae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "cinder-quobyte-02381f1d-7e06-429c-a486-0a0a3545adae" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-02381f1d-7e06-429c-a486-0a0a3545adae" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Deleting offline snapshot 02381f1d-7e06-429c-a486-0a0a3545adae of volume 6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] snapshot_file for this snap is: volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e546158e-b58f-48d8-b60e-ea6cd59ef95c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:54 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae Aug 26 00:05:54 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:54 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d4749c-c531-4b8c-9b27-16d433e93dc1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Acquiring lock "cinder-b79e2a01-6e37-4f10-882c-9d563539712b-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "cinder-b79e2a01-6e37-4f10-882c-9d563539712b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:55 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 Aug 26 00:05:55 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Acquiring lock "cinder-quobyte-b79e2a01-6e37-4f10-882c-9d563539712b" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "cinder-quobyte-b79e2a01-6e37-4f10-882c-9d563539712b" acquired by "delete_volume" :: waited 0.047s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1daf798-af31-46fc-9d87-434a538b3950]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:55 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" returned: 0 in 0.482s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:55 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae Aug 26 00:05:55 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:55 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b Aug 26 00:05:55 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:56 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae" returned: 0 in 0.580s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:56 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b" returned: 0 in 0.809s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:56 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae Aug 26 00:05:56 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:56 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b Aug 26 00:05:56 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:56 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190.02381f1d-7e06-429c-a486-0a0a3545adae" returned: 0 in 0.464s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:56 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b79e2a01-6e37-4f10-882c-9d563539712b" returned: 0 in 0.443s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "cinder-quobyte-b79e2a01-6e37-4f10-882c-9d563539712b" released by "delete_volume" :: held 1.371s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-02381f1d-7e06-429c-a486-0a0a3545adae" released by "_delete_snapshot" :: held 2.208s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" released by "delete_snapshot" :: held 2.252s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:56 devstack cinder-volume[94433]: WARNING cinder.quota [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:05:56 devstack cinder-volume[94433]: WARNING cinder.quota [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Created reservations ['5edb7788-6232-4029-8da5-81dc79521159', '2d21d3af-f2f3-42fb-9d3b-0092ee1f1499', 'bec4abaa-237f-4ad0-b02f-1fab026ded6d', '4fe04997-0adb-430d-91f8-d26e68e8791c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:05:56 devstack cinder-volume[94433]: WARNING cinder.quota [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.quota [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Created reservations ['d31a1c1c-136c-498d-bdf8-182278286b63', '9ed257ee-beae-4edc-9f0e-8b08510c868d', 'fe6c8f0e-bee9-44dc-b9b1-2db20630e0aa', '060984f3-3a5e-4362-b14f-420900b47463'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:57 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:05:57 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Delete snapshot completed successfully. Aug 26 00:05:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-f6b585d1-2b9d-49be-859d-e3644da72d6f req-17611915-7ee6-4cf7-9524-ce3721d08728 tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-02381f1d-7e06-429c-a486-0a0a3545adae-delete_snapshot" released by "delete_snapshot" :: held 2.693s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:57 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.418s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:57 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:05:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Deleted volume successfully. Aug 26 00:05:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-543e9998-d5e6-4bd1-855d-78b312f2d10a tempest-VolumesAdminNegativeTest-2090365712 None] Lock "cinder-b79e2a01-6e37-4f10-882c-9d563539712b-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "cinder-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" acquired by "delete_volume" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d96f92-1566-4836-861d-637aa23b11a2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:58 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 Aug 26 00:05:58 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:58 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" returned: 0 in 0.617s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:59 devstack sudo[96113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190 Aug 26 00:05:59 devstack sudo[96113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:59 devstack sudo[96113]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-quobyte-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190" released by "delete_volume" :: held 0.952s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.quota [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Created reservations ['cfda0de2-aefc-4958-a214-97be1341c408', '105d506d-4f9e-4d13-af93-b427af30517c', 'a4cc3c07-c81c-4e6c-8c4c-cdf2ba412b37', '8762de2f-d899-452e-9ca9-3b663cf15c3a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:05:59 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:05:59 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:05:59 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.manager [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:05:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Deleted volume successfully. Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-99a3a7d3-2a33-41cb-ad0e-6e1f07d00b97 req-52d2b2aa-daec-47f3-8c9b-fd00c0f768ef tempest-VolumesSnapshotsTestJSON-940150563 None] Lock "cinder-6d1fa9c3-1ecb-4a3f-beab-b8145dc17190-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:05:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-d3b41390-01ed-4e72-b2b2-a51c19c81b27 req-8abc6bff-da1e-43bd-b48f-a6d0db5c9d70 tempest-DeleteServersTestJSON-1152427846 None] Terminate volume connection completed successfully. Aug 26 00:05:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-d3b41390-01ed-4e72-b2b2-a51c19c81b27 req-8abc6bff-da1e-43bd-b48f-a6d0db5c9d70 tempest-DeleteServersTestJSON-1152427846 None] Deleting attachment b26955fc-89ba-4f26-9e23-950d6e18f9d9. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "cinder-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "cinder-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "cinder-quobyte-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "cinder-quobyte-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[183bcc00-924a-49dd-9a45-01312cc15857]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:01 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 Aug 26 00:06:01 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:02 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" returned: 0 in 0.511s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:02 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978 Aug 26 00:06:02 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:02 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "cinder-quobyte-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978" released by "delete_volume" :: held 0.887s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Created reservations ['6122a6ed-b766-43e5-80a0-026ec0ab42ed', 'a2c036e6-3560-44b9-a60e-68f7d4c0cc9b', '364e3ffa-64cd-436e-9cd5-25e68cfcbdbd', '06d47237-4b45-4d22-8309-590af8941342'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:02 devstack sudo[96134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:06:02 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:02 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.284s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:02 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:06:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Deleted volume successfully. Aug 26 00:06:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c0203066-009e-43ed-aeab-d010cef80d30 tempest-DeleteServersTestJSON-1152427846 None] Lock "cinder-60c82f33-a3f3-4a4d-9a30-9aeb41ecb978-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f2e8ecbf-31df-410d-b9e8-a5a52688a258 tempest-BackendsCapabilitiesAdminTestsJSON-365461217 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.904396057129, 'free_capacity_gb': 1774.904396057129, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94433) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 00:06:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-da97ecfc-df9b-4cf7-a987-844859515781 tempest-BackendsCapabilitiesAdminTestsJSON-365461217 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.904396057129, 'free_capacity_gb': 1774.904396057129, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94433) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 00:06:12 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=38,cinder:SELECT=33,cinder:INSERT=11,cinder:DELETE=4 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:06:13 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=42,cinder:UPDATE=45,cinder:DELETE=3,cinder:INSERT=9 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:06:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1382745a-9ef6-4d92-a90b-68c2491c3e97 tempest-GroupsV314Test-57112784 None] Group tempest-GroupsV314Test-Group-101091185: creating Aug 26 00:06:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1382745a-9ef6-4d92-a90b-68c2491c3e97 tempest-GroupsV314Test-57112784 None] Group tempest-GroupsV314Test-Group-101091185: created successfully Aug 26 00:06:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1382745a-9ef6-4d92-a90b-68c2491c3e97 tempest-GroupsV314Test-57112784 None] Create group completed successfully. Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Flow 'volume_create_manager' (588f2018-df67-4ad6-bebb-2adb9023095f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3379a28-2685-4429-b793-4a39e533a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3379a28-2685-4429-b793-4a39e533a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100649962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2edd3d45-b20c-41c4-9329-fe944b1694ee,host='devstack@QuobyteHD#QuobyteHD',id=a917d5f2-e769-43bc-ac35-bae6cde2bdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c737b7174e694c8a931a6ba14f8555a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:06:21Z,use_quota=True,user_id='f77e473750574505b7b375d31ac04acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87088432-0913-4f9f-bc79-20727e963801),volume_type_id=87088432-0913-4f9f-bc79-20727e963801)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640852bd-c157-42e8-b1a5-3dbb834ce56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640852bd-c157-42e8-b1a5-3dbb834ce56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3daa75-fd97-4d21-8a91-444c0f77d1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3daa75-fd97-4d21-8a91-444c0f77d1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a917d5f2-e769-43bc-ac35-bae6cde2bdb0', 'volume_name': 'volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70035d56-f44c-4a57-a5c5-b7a69eb22443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70035d56-f44c-4a57-a5c5-b7a69eb22443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1eb9e-7aa7-4a3b-a83e-10431bebf881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Volume a917d5f2-e769-43bc-ac35-bae6cde2bdb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0', 'volume_size': 1} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2edd3d45-b20c-41c4-9329-fe944b1694ee,created_at=2026-08-25T22:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-100649962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2edd3d45-b20c-41c4-9329-fe944b1694ee,host='devstack@QuobyteHD#QuobyteHD',id=a917d5f2-e769-43bc-ac35-bae6cde2bdb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c737b7174e694c8a931a6ba14f8555a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:06:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:06:21Z,use_quota=True,user_id='f77e473750574505b7b375d31ac04acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87088432-0913-4f9f-bc79-20727e963801),volume_type_id=87088432-0913-4f9f-bc79-20727e963801)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Creating volume a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:06:21 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:06:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:21 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 1073741824 Aug 26 00:06:21 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:22 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 1073741824" returned: 0 in 0.657s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:22 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:22 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:22 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.287s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc1eb9e-7aa7-4a3b-a83e-10431bebf881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc943feb-d61a-4da3-84a8-07dc05aefdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:22 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Volume volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 (a917d5f2-e769-43bc-ac35-bae6cde2bdb0): created successfully Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc943feb-d61a-4da3-84a8-07dc05aefdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Flow 'volume_create_manager' (588f2018-df67-4ad6-bebb-2adb9023095f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:06:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0df7c154-51e3-4de6-8d4b-8ab9ba266de8 tempest-GroupsV314Test-57112784 None] Created volume successfully. Aug 26 00:06:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:24 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Cloning volume a917d5f2-e769-43bc-ac35-bae6cde2bdb0 to volume 8d70197b-febb-4844-970c-6d1aa50b9ed3 Aug 26 00:06:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Creating offline snapshot 5d9bfd93-65a2-49b9-9edc-6be7134db96d of volume a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:06:24 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[169dc835-630a-4869-861b-71fdfed8adc4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:24 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:24 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:25 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.480s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:25 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d 1G Aug 26 00:06:25 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:25 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d 1G" returned: 0 in 0.565s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:25 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:25 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:26 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:26 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:26 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:26 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:26 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:26 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info Aug 26 00:06:26 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:26 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info" returned: 0 in 0.289s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:26 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:06:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:26 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info Aug 26 00:06:26 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:27 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.info" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Acquiring lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] snapshot: 5d9bfd93-65a2-49b9-9edc-6be7134db96d, volume: 8d70197b-febb-4844-970c-6d1aa50b9ed3, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff66b97b-8a1b-47cf-af83-b487403346c7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:27 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:27 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:27 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.528s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c933a784-86a4-4453-9fd5-32b11fdafaca]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:27 devstack sudo[96202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:27 devstack sudo[96202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:28 devstack sudo[96202]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.381s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:06:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:06:28 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:06:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:28 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 Aug 26 00:06:28 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:34 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3" returned: 0 in 5.969s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:06:34 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Converted 1024.00 MB image at 171.53 MB/s Aug 26 00:06:34 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:34 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 Aug 26 00:06:34 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:34 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3" returned: 0 in 0.308s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" released by "_copy_volume_from_snapshot" :: held 7.279s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Acquiring lock "cinder-quobyte-5d9bfd93-65a2-49b9-9edc-6be7134db96d" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-5d9bfd93-65a2-49b9-9edc-6be7134db96d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Deleting offline snapshot 5d9bfd93-65a2-49b9-9edc-6be7134db96d of volume a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] snapshot_file for this snap is: volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[af097bd0-2272-4b11-a614-0b83ffa912a1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:34 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:34 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:35 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.518s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:06:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2d9566-d527-424e-a9a5-b36220eefdad]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:35 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:35 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:36 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.823s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:36 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:36 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:36 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.546s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:36 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d Aug 26 00:06:36 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:06:36 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0.5d9bfd93-65a2-49b9-9edc-6be7134db96d" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-5d9bfd93-65a2-49b9-9edc-6be7134db96d" released by "_delete_snapshot" :: held 2.409s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.261s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-21093d96-e5bd-456a-93d5-6b986885bc74 tempest-GroupsV314Test-57112784 None] Create group from source-group-2edd3d45-b20c-41c4-9329-fe944b1694ee completed successfully. Aug 26 00:06:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Acquiring lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" acquired by "delete_volume" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[533e3266-0faf-42d9-81ee-d394f2ecceaa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:38 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 Aug 26 00:06:38 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:39 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3" returned: 0 in 0.564s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:39 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3 Aug 26 00:06:39 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:39 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d70197b-febb-4844-970c-6d1aa50b9ed3" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-8d70197b-febb-4844-970c-6d1aa50b9ed3" released by "delete_volume" :: held 1.050s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Created reservations ['d82c1eb5-9687-45b1-a39a-5f2824eb4e82'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:06:39 devstack cinder-volume[94433]: WARNING cinder.quota [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1969099198 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1969099198, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:06:39 devstack cinder-volume[94433]: WARNING cinder.quota [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1969099198 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1969099198, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:06:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Created reservations ['cf7dad9c-95ac-484d-935f-6cc4466cac04', 'fe32833f-9fff-4336-827a-c5a00c85aa29', 'ed0a8977-8845-4a74-96d0-f930a132baef', '5f217308-d874-4237-ba9b-132f1700034a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:40 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:06:40 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:40 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.329s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:40 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:06:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-893d9444-cafa-4434-8d50-dbd9b96ec9a6 tempest-GroupsV314Test-57112784 None] Delete group completed successfully. Aug 26 00:06:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Acquiring lock "cinder-quobyte-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:06:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:06:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea421370-5492-40fb-9e42-8521f74a72ed]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:06:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:41 devstack sudo[96275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:41 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:42 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.415s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:42 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0 Aug 26 00:06:42 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:42 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Lock "cinder-quobyte-a917d5f2-e769-43bc-ac35-bae6cde2bdb0" released by "delete_volume" :: held 0.852s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Created reservations ['b124b96b-ffc1-4093-b945-5fa6909dc0a8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Created reservations ['33b3820f-d1f2-4887-bc7f-e4bd013c0be8', 'd5387a26-d41c-4c98-98de-2d3b5488aecd', '7cb9faa0-e5f7-4635-be5b-1f0fac6803b4', '0116a2a4-380f-42ac-a980-884e6d7899e5'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:42 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:06:42 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:43 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.308s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:43 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:06:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-65295b94-b947-40d6-a741-31e100dd780c tempest-GroupsV314Test-57112784 None] Delete group completed successfully. Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:46 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:06:46 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:46 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.299s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 8 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:06:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:06:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=33,cinder:UPDATE=30,cinder:INSERT=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:06:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Flow 'volume_create_manager' (e1c74d0d-8ea6-49cd-9139-b349700882ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd729ade-01b5-43ea-be71-9475db25fad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd729ade-01b5-43ea-be71-9475db25fad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-882347508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d07d73a-da13-4735-8017-7eb9b62494a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3e78abf5d84e49bd882ae1746496ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:06:57Z,use_quota=True,user_id='ab801fe267d24388ae61b32e78f26e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14446545-51a1-4900-872a-8aeb29ced140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14446545-51a1-4900-872a-8aeb29ced140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1203f659-c86c-4cb4-9eb1-1832d77097ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1203f659-c86c-4cb4-9eb1-1832d77097ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d07d73a-da13-4735-8017-7eb9b62494a7', 'volume_name': 'volume-8d07d73a-da13-4735-8017-7eb9b62494a7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e2786-4ca0-4ada-b15a-4dcbe26d6c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e2786-4ca0-4ada-b15a-4dcbe26d6c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88284405-5bdc-4dd4-b73c-2fcea33f269c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Volume 8d07d73a-da13-4735-8017-7eb9b62494a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d07d73a-da13-4735-8017-7eb9b62494a7', 'volume_size': 1} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-882347508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d07d73a-da13-4735-8017-7eb9b62494a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c3e78abf5d84e49bd882ae1746496ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:06:57Z,use_quota=True,user_id='ab801fe267d24388ae61b32e78f26e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Creating volume 8d07d73a-da13-4735-8017-7eb9b62494a7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:06:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:06:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:57 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 1073741824 Aug 26 00:06:57 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:58 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 1073741824" returned: 0 in 1.012s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:06:58 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 Aug 26 00:06:58 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:06:59 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7" returned: 0 in 0.549s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88284405-5bdc-4dd4-b73c-2fcea33f269c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d07d73a-da13-4735-8017-7eb9b62494a7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5048be-2ba4-4717-a083-e0c6327558e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:06:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Volume volume-8d07d73a-da13-4735-8017-7eb9b62494a7 (8d07d73a-da13-4735-8017-7eb9b62494a7): created successfully Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5048be-2ba4-4717-a083-e0c6327558e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:06:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Flow 'volume_create_manager' (e1c74d0d-8ea6-49cd-9139-b349700882ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:06:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0d2fc6eb-e914-4aed-8148-9e2fb5f1364a tempest-TaggedAttachmentsTest-1389893232 None] Created volume successfully. Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Flow 'volume_create_manager' (43fa4035-de2f-4cf4-b7ad-a76066afcd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3725b6-a633-4672-8082-ab0ece4113bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d3725b6-a633-4672-8082-ab0ece4113bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-64519759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cf305a-3cee-4fa4-812e-36728d048c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02959ecd19c54988af2ae0ee6f045d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:01Z,use_quota=True,user_id='ca3d936ab93643f3bc843b395109dc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df1ba91-d102-46da-91e0-1eb77d0a8ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6df1ba91-d102-46da-91e0-1eb77d0a8ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badf1b1c-b9f0-4971-b210-9c433934f2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badf1b1c-b9f0-4971-b210-9c433934f2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4cf305a-3cee-4fa4-812e-36728d048c1f', 'volume_name': 'volume-f4cf305a-3cee-4fa4-812e-36728d048c1f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed189d74-f7a5-4f1f-9f83-2b9f41f6d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed189d74-f7a5-4f1f-9f83-2b9f41f6d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2723494-13f5-467f-86c1-e806575988a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume f4cf305a-3cee-4fa4-812e-36728d048c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4cf305a-3cee-4fa4-812e-36728d048c1f', 'volume_size': 1} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-64519759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4cf305a-3cee-4fa4-812e-36728d048c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02959ecd19c54988af2ae0ee6f045d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:01Z,use_quota=True,user_id='ca3d936ab93643f3bc843b395109dc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Creating volume f4cf305a-3cee-4fa4-812e-36728d048c1f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:07:00 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:07:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:00 devstack sudo[96411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f 1073741824 Aug 26 00:07:00 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:01 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f 1073741824" returned: 0 in 0.575s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:01 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f Aug 26 00:07:01 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:01 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f" returned: 0 in 0.319s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2723494-13f5-467f-86c1-e806575988a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4cf305a-3cee-4fa4-812e-36728d048c1f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5224a082-54fd-44dd-9180-abdb27fd2656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume volume-f4cf305a-3cee-4fa4-812e-36728d048c1f (f4cf305a-3cee-4fa4-812e-36728d048c1f): created successfully Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5224a082-54fd-44dd-9180-abdb27fd2656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Flow 'volume_create_manager' (43fa4035-de2f-4cf4-b7ad-a76066afcd83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f901a75a-9b34-4b67-84bb-aee95615a88d tempest-VolumeQuotasAdminTestJSON-1170691369 None] Created volume successfully. Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "cinder-f4cf305a-3cee-4fa4-812e-36728d048c1f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "cinder-f4cf305a-3cee-4fa4-812e-36728d048c1f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "cinder-quobyte-f4cf305a-3cee-4fa4-812e-36728d048c1f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "cinder-quobyte-f4cf305a-3cee-4fa4-812e-36728d048c1f" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8321c9b-1b8f-405f-8538-91aad00cedaf]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:03 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f Aug 26 00:07:03 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:03 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f" returned: 0 in 0.492s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:03 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f Aug 26 00:07:03 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:03 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f4cf305a-3cee-4fa4-812e-36728d048c1f" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "cinder-quobyte-f4cf305a-3cee-4fa4-812e-36728d048c1f" released by "delete_volume" :: held 0.982s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Created reservations ['5d86e32e-3882-4876-8757-eab2c34085a9', '186565bc-d33e-426b-a41f-24d248d925a6', 'cb0db3c5-caa6-4f4f-b7de-e85ecda88daa', '05caf37a-8a9a-4b70-bfd8-635f4e62937a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:04 devstack sudo[96484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:07:04 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:04 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.497s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:07:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Deleted volume successfully. Aug 26 00:07:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-68275d9c-5b54-46a3-aebd-0a24488cb3af tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "cinder-f4cf305a-3cee-4fa4-812e-36728d048c1f-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Flow 'volume_create_manager' (7bf2fe93-7987-4037-a6c5-9e609d7bc768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52589e0-b3b6-49f1-9408-bb7450296b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e52589e0-b3b6-49f1-9408-bb7450296b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861313989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca18702f-a47d-4691-9756-55df9b12ef61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02959ecd19c54988af2ae0ee6f045d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:06Z,use_quota=True,user_id='ca3d936ab93643f3bc843b395109dc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322f736-960b-4c5b-98f4-75d11667c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322f736-960b-4c5b-98f4-75d11667c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310709cd-a2f6-493d-884d-1c3a4a71cb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310709cd-a2f6-493d-884d-1c3a4a71cb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca18702f-a47d-4691-9756-55df9b12ef61', 'volume_name': 'volume-ca18702f-a47d-4691-9756-55df9b12ef61', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c9c0e3-5ff8-47a6-b77e-2047c33181c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c9c0e3-5ff8-47a6-b77e-2047c33181c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708070c-d96a-4260-a661-a826fa5abee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume ca18702f-a47d-4691-9756-55df9b12ef61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca18702f-a47d-4691-9756-55df9b12ef61', 'volume_size': 1} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861313989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca18702f-a47d-4691-9756-55df9b12ef61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02959ecd19c54988af2ae0ee6f045d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:06Z,use_quota=True,user_id='ca3d936ab93643f3bc843b395109dc0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Creating volume ca18702f-a47d-4691-9756-55df9b12ef61 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:07:06 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:07:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:06 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 1073741824 Aug 26 00:07:06 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:07 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 1073741824" returned: 0 in 0.707s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:07 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 Aug 26 00:07:07 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:07 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61" returned: 0 in 0.311s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7708070c-d96a-4260-a661-a826fa5abee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca18702f-a47d-4691-9756-55df9b12ef61', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14431913-2e43-49cc-bf20-65457e863bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Volume volume-ca18702f-a47d-4691-9756-55df9b12ef61 (ca18702f-a47d-4691-9756-55df9b12ef61): created successfully Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14431913-2e43-49cc-bf20-65457e863bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Flow 'volume_create_manager' (7bf2fe93-7987-4037-a6c5-9e609d7bc768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bbb7e5dc-38d2-470e-a542-1ba7b7718d72 tempest-VolumeQuotasAdminTestJSON-1170691369 None] Created volume successfully. Aug 26 00:07:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-adb184ac-b9fe-46af-b4ec-82656b5769ea tempest-VolumeQuotasAdminTestJSON-440074922 None] Transfer volume completed successfully. Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Acquiring lock "cinder-ca18702f-a47d-4691-9756-55df9b12ef61-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "cinder-ca18702f-a47d-4691-9756-55df9b12ef61-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Acquiring lock "cinder-quobyte-ca18702f-a47d-4691-9756-55df9b12ef61" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "cinder-quobyte-ca18702f-a47d-4691-9756-55df9b12ef61" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e0d1d0-7ffe-4177-8ecf-1d27dc54ba4a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:12 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 Aug 26 00:07:12 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:12 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61" returned: 0 in 1.045s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:13 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61 Aug 26 00:07:13 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:13 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ca18702f-a47d-4691-9756-55df9b12ef61" returned: 0 in 0.816s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "cinder-quobyte-ca18702f-a47d-4691-9756-55df9b12ef61" released by "delete_volume" :: held 1.945s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Created reservations ['a75abecc-5a12-4022-ad8d-216eeefc1963', 'f8dcf30e-3570-43d9-80cd-e3d02574d423', '73392d38-adc1-4342-b8d3-e0363a222a47', '1e359181-bbd2-4d47-93a8-eb5d46f2990c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:14 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:07:14 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:14 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.733s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:07:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Deleted volume successfully. Aug 26 00:07:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f57e3277-9ef1-4d0a-87ed-ac8d5bb7fabe tempest-VolumeQuotasAdminTestJSON-331415208 None] Lock "cinder-ca18702f-a47d-4691-9756-55df9b12ef61-delete_volume" released by "delete_volume" :: held 3.128s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:24 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=24,cinder:SELECT=17,cinder:INSERT=6,cinder:DELETE=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:07:24 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=16,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=5 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Flow 'volume_create_manager' (6593fb13-b36b-4417-ab8f-0cc10e9a528d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b60c7c3-3b4b-4292-b581-e947eea0fb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b60c7c3-3b4b-4292-b581-e947eea0fb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1894230441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9898220-4366-48fd-b238-e293afc0e8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28e5896e3ab42c5aa593eae354d7266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:28Z,use_quota=True,user_id='e72be450cf3d4c319316fcc82e5a4b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6f8b80-e6b8-4ee4-965e-f32264242c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6f8b80-e6b8-4ee4-965e-f32264242c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819e5827-a14a-49eb-b76a-805a5b12b35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819e5827-a14a-49eb-b76a-805a5b12b35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9898220-4366-48fd-b238-e293afc0e8a6', 'volume_name': 'volume-b9898220-4366-48fd-b238-e293afc0e8a6', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570d6de-a0df-40a2-9b6b-b6d29df21639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9570d6de-a0df-40a2-9b6b-b6d29df21639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf09b9f5-7110-4433-af41-ab20ec4b060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Volume b9898220-4366-48fd-b238-e293afc0e8a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9898220-4366-48fd-b238-e293afc0e8a6', 'volume_size': 1} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1894230441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9898220-4366-48fd-b238-e293afc0e8a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e28e5896e3ab42c5aa593eae354d7266',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:28Z,use_quota=True,user_id='e72be450cf3d4c319316fcc82e5a4b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Creating volume b9898220-4366-48fd-b238-e293afc0e8a6 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:07:28 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:07:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:28 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 1073741824 Aug 26 00:07:28 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:29 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 1073741824" returned: 0 in 0.876s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:29 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 Aug 26 00:07:29 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:29 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf09b9f5-7110-4433-af41-ab20ec4b060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9898220-4366-48fd-b238-e293afc0e8a6', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6884c-517f-4037-b12f-7bfbc07d4182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Volume volume-b9898220-4366-48fd-b238-e293afc0e8a6 (b9898220-4366-48fd-b238-e293afc0e8a6): created successfully Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ee6884c-517f-4037-b12f-7bfbc07d4182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Flow 'volume_create_manager' (6593fb13-b36b-4417-ab8f-0cc10e9a528d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8cc27824-886d-414e-a3e8-3c7d4581dc47 tempest-ServerRescueNegativeTestJSON-455566981 None] Created volume successfully. Aug 26 00:07:39 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:07:40 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Flow 'volume_create_manager' (473e1e03-7998-4f77-a5b3-bf463985a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb93a68-7b0f-4549-b063-aeb248491e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb93a68-7b0f-4549-b063-aeb248491e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1390391031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6382bc-59d0-4890-9366-898c7b47f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acd17ede4ea4128ad405dc5d3adca9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:44Z,use_quota=True,user_id='35703c3025c6467eac947256adbb18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016754d-24b2-4852-9b63-f31438dde561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6016754d-24b2-4852-9b63-f31438dde561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215ffd1-78e2-4497-b583-d15557da81e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a215ffd1-78e2-4497-b583-d15557da81e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6382bc-59d0-4890-9366-898c7b47f75c', 'volume_name': 'volume-0a6382bc-59d0-4890-9366-898c7b47f75c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a4b3b2-c16c-4648-86dc-78516c6fe6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a4b3b2-c16c-4648-86dc-78516c6fe6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43be6c-c6e1-4592-80a3-7b87a8c2dfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:44 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Volume 0a6382bc-59d0-4890-9366-898c7b47f75c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6382bc-59d0-4890-9366-898c7b47f75c', 'volume_size': 1} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1390391031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6382bc-59d0-4890-9366-898c7b47f75c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acd17ede4ea4128ad405dc5d3adca9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:44Z,use_quota=True,user_id='35703c3025c6467eac947256adbb18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Creating volume 0a6382bc-59d0-4890-9366-898c7b47f75c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:07:44 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:07:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:44 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c 1073741824 Aug 26 00:07:44 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:45 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c 1073741824" returned: 0 in 0.742s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:45 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c Aug 26 00:07:45 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Acquiring lock "cinder-b9898220-4366-48fd-b238-e293afc0e8a6-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "cinder-b9898220-4366-48fd-b238-e293afc0e8a6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Acquiring lock "cinder-quobyte-b9898220-4366-48fd-b238-e293afc0e8a6" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "cinder-quobyte-b9898220-4366-48fd-b238-e293afc0e8a6" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc2ccc7-d5f0-40b7-8210-78348c975543]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:45 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c" returned: 0 in 0.444s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43be6c-c6e1-4592-80a3-7b87a8c2dfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6382bc-59d0-4890-9366-898c7b47f75c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9126c46-053f-4be3-b32d-267e8522d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:45 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Volume volume-0a6382bc-59d0-4890-9366-898c7b47f75c (0a6382bc-59d0-4890-9366-898c7b47f75c): created successfully Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9126c46-053f-4be3-b32d-267e8522d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Flow 'volume_create_manager' (473e1e03-7998-4f77-a5b3-bf463985a955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5dc880da-c539-456d-92cf-2d4929534580 tempest-ServerActionsTestOtherA-1604735046 None] Created volume successfully. Aug 26 00:07:45 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 Aug 26 00:07:45 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (75b6c652-2634-4bee-8fd9-4dbe63ef9206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7a1d7f-2e61-4ab6-8666-c53e1e11bf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d7a1d7f-2e61-4ab6-8666-c53e1e11bf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-51296669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64159531-83e7-4831-92c1-695846d9a5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3601188068c24422b360b62d9ca52abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:46Z,use_quota=True,user_id='eb7bcad1a0c84e0f94d74fc21dc968c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:46 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3697a6-6eeb-4e8d-a96d-69d2db81b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec3697a6-6eeb-4e8d-a96d-69d2db81b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fcb1ad-e367-44ae-b1a6-b2605737b25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51fcb1ad-e367-44ae-b1a6-b2605737b25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64159531-83e7-4831-92c1-695846d9a5f4', 'volume_name': 'volume-64159531-83e7-4831-92c1-695846d9a5f4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccf3563-d817-4219-8301-99ea1230bc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bccf3563-d817-4219-8301-99ea1230bc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a99489-25d2-4301-9ceb-2f077d660bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:46 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Volume 64159531-83e7-4831-92c1-695846d9a5f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64159531-83e7-4831-92c1-695846d9a5f4', 'volume_size': 1} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-51296669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64159531-83e7-4831-92c1-695846d9a5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3601188068c24422b360b62d9ca52abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:07:46Z,use_quota=True,user_id='eb7bcad1a0c84e0f94d74fc21dc968c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Creating volume 64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:07:46 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6" returned: 0 in 0.673s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:46 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 1073741824 Aug 26 00:07:46 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:46 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6 Aug 26 00:07:46 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:46 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9898220-4366-48fd-b238-e293afc0e8a6" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:46 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:07:46 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "cinder-quobyte-b9898220-4366-48fd-b238-e293afc0e8a6" released by "delete_volume" :: held 1.096s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Created reservations ['03dacc62-8663-4259-9ccf-bb1bdcb2aaf7', 'f95d30cb-891c-4dac-821e-5a9f2d82315b', '1e7db8dc-3d58-4765-87c4-1684cb0cdc25', '82d4a1b3-8ade-4eb0-bb26-a85ed73d6465'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:46 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.354s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:07:46 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:07:46 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 8 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:07:46 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 1073741824" returned: 0 in 0.753s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:47 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 Aug 26 00:07:47 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:47 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:07:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Deleted volume successfully. Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce180092-5560-4936-8a08-c82bd8a16fb8 tempest-ServerRescueNegativeTestJSON-455566981 None] Lock "cinder-b9898220-4366-48fd-b238-e293afc0e8a6-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:47 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a99489-25d2-4301-9ceb-2f077d660bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64159531-83e7-4831-92c1-695846d9a5f4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867f425-44e8-4431-8489-cf5aa080f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:07:47 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Volume volume-64159531-83e7-4831-92c1-695846d9a5f4 (64159531-83e7-4831-92c1-695846d9a5f4): created successfully Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5867f425-44e8-4431-8489-cf5aa080f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:07:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (75b6c652-2634-4bee-8fd9-4dbe63ef9206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:07:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a8774bb6-d738-4862-b176-d32669ed418b tempest-VolumesDeleteCascade-1670055061 None] Created volume successfully. Aug 26 00:07:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Creating offline snapshot 94342281-4dc2-4d6c-885c-c415388aeccc of volume 64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:07:48 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d88745-e92e-4642-9189-0f5439ba808f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:48 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 Aug 26 00:07:48 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:49 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4" returned: 0 in 0.711s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:49 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc 1G Aug 26 00:07:49 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:50 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc 1G" returned: 0 in 0.854s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:50 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:50 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:50 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.626s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:50 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc is being set with open permissions: ugo+rw Aug 26 00:07:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:50 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:50 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:51 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.582s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:51 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info Aug 26 00:07:51 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:51 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info" returned: 0 in 0.486s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:51 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info is being set with open permissions: ugo+rw Aug 26 00:07:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:51 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info Aug 26 00:07:51 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:52 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.info" returned: 0 in 0.537s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.983s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b83d3070-c5cb-4163-b463-efd331d5372a tempest-VolumesDeleteCascade-1670055061 None] Create snapshot completed successfully Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Creating offline snapshot 04b73544-7118-4592-ae5c-23012aadef7b of volume 64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ff4377-7e2c-4f27-aed2-e8ebbb574d97]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:53 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:53 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:53 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.496s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64159531-83e7-4831-92c1-695846d9a5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:07:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:53 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b 1G Aug 26 00:07:53 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:54 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b 1G" returned: 0 in 0.660s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:54 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b Aug 26 00:07:54 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:54 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:54 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b is being set with open permissions: ugo+rw Aug 26 00:07:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:54 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b Aug 26 00:07:54 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:55 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:07:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8b011dc0-a4c3-4f5e-93ee-3f2ba59d8043 tempest-VolumesDeleteCascade-1670055061 None] Create snapshot completed successfully Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-64159531-83e7-4831-92c1-695846d9a5f4-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-64159531-83e7-4831-92c1-695846d9a5f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Performing cascade delete. {{(pid=94433) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-04b73544-7118-4592-ae5c-23012aadef7b-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-04b73544-7118-4592-ae5c-23012aadef7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-04b73544-7118-4592-ae5c-23012aadef7b" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-04b73544-7118-4592-ae5c-23012aadef7b" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Deleting offline snapshot 04b73544-7118-4592-ae5c-23012aadef7b of volume 64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] snapshot_file for this snap is: volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[43020ba3-1a74-43d1-bba8-41770f096ed2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:55 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b Aug 26 00:07:55 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:56 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64159531-83e7-4831-92c1-695846d9a5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd4782c-ba91-4a88-9cc3-48ec34de677a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:56 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:56 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:56 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64159531-83e7-4831-92c1-695846d9a5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:07:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:56 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b Aug 26 00:07:56 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:57 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b" returned: 0 in 0.501s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:57 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b Aug 26 00:07:57 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:57 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.04b73544-7118-4592-ae5c-23012aadef7b" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-04b73544-7118-4592-ae5c-23012aadef7b" released by "_delete_snapshot" :: held 1.918s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" released by "delete_snapshot" :: held 1.954s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['1da023d8-88c7-451f-b3dc-2f5f7359aa13', '62dec44f-e310-4820-bf5f-c05ad31df05b', 'a6e7f6c4-5e64-4085-ae81-d3c4ee723ca6', 'a52dfcfc-4ab0-49c7-be76-32c5a58c0222'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:07:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Delete snapshot completed successfully. Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-04b73544-7118-4592-ae5c-23012aadef7b-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-94342281-4dc2-4d6c-885c-c415388aeccc-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-94342281-4dc2-4d6c-885c-c415388aeccc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-94342281-4dc2-4d6c-885c-c415388aeccc" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-94342281-4dc2-4d6c-885c-c415388aeccc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Deleting offline snapshot 94342281-4dc2-4d6c-885c-c415388aeccc of volume 64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] snapshot_file for this snap is: volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[01846dc8-49e9-48bd-bce1-94ad4cb5b5fc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:58 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:58 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:58 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.555s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64159531-83e7-4831-92c1-695846d9a5f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:07:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa28d8d8-0402-4408-a7c4-1e9103ffabea]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:07:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:58 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 Aug 26 00:07:58 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:58 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4" returned: 0 in 0.567s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:59 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:59 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:59 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:07:59 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc Aug 26 00:07:59 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:07:59 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4.94342281-4dc2-4d6c-885c-c415388aeccc" returned: 0 in 0.311s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-94342281-4dc2-4d6c-885c-c415388aeccc" released by "_delete_snapshot" :: held 2.074s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" released by "delete_snapshot" :: held 2.100s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:07:59 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['d7309b82-918e-41a3-80d3-158e7f29151b', 'ce25ff8f-50ae-4d68-b47f-a2f116e25ca3', '48ea1ec7-e813-4549-b840-3a83e02612f1', 'bf25b3df-e7df-4501-a1fa-13114c11f08e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Delete snapshot completed successfully. Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-94342281-4dc2-4d6c-885c-c415388aeccc-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Snapshots deleted, issuing volume delete {{(pid=94433) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6923902f-c93d-4a03-85c5-19512855e0b0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:00 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 Aug 26 00:08:00 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:00 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4" returned: 0 in 0.465s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:00 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4 Aug 26 00:08:00 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:00 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64159531-83e7-4831-92c1-695846d9a5f4" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-64159531-83e7-4831-92c1-695846d9a5f4" released by "delete_volume" :: held 0.866s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['34c66db7-6b48-4560-9345-ccdf67b9aea7', '27ae236c-14fd-47d3-8856-b9a97dbe93c0', '94fca7d2-b38c-42d4-8ed6-2e7985daee8e', '47fb27f8-eabc-4e58-b703-ff4371dce857'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:01 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:01 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:01 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.343s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Deleted volume successfully. Aug 26 00:08:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6844009c-cbe8-4473-8594-57ab577b638c tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-64159531-83e7-4831-92c1-695846d9a5f4-delete_volume" released by "delete_volume" :: held 6.115s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (0cbdfcf1-8c43-4984-b3bd-39a59a7d5044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d49333c-1d3f-44d6-8a90-99d503e61164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d49333c-1d3f-44d6-8a90-99d503e61164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1326180057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997724b0-8f24-4d48-b833-b4bdf5ba55ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3601188068c24422b360b62d9ca52abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:03Z,use_quota=True,user_id='eb7bcad1a0c84e0f94d74fc21dc968c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c2847-6bda-4a60-a7af-bb0fa68aa60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731c2847-6bda-4a60-a7af-bb0fa68aa60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cfe67c-7a62-414c-90fb-833bb361741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9cfe67c-7a62-414c-90fb-833bb361741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997724b0-8f24-4d48-b833-b4bdf5ba55ed', 'volume_name': 'volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb00bb16-6cb9-4f9a-9b0a-c34e540b220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb00bb16-6cb9-4f9a-9b0a-c34e540b220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212c1880-8089-460c-9a6d-8217cf1ac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Volume 997724b0-8f24-4d48-b833-b4bdf5ba55ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed', 'volume_size': 1} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1326180057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997724b0-8f24-4d48-b833-b4bdf5ba55ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3601188068c24422b360b62d9ca52abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:03Z,use_quota=True,user_id='eb7bcad1a0c84e0f94d74fc21dc968c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Creating volume 997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:02 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:08:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:02 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed 1073741824 Aug 26 00:08:02 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:03 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed 1073741824" returned: 0 in 0.563s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:03 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:03 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:03 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.294s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212c1880-8089-460c-9a6d-8217cf1ac950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a39a0-cc04-4b95-bdeb-1a12f50fd7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:03 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Volume volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed (997724b0-8f24-4d48-b833-b4bdf5ba55ed): created successfully Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a39a0-cc04-4b95-bdeb-1a12f50fd7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (0cbdfcf1-8c43-4984-b3bd-39a59a7d5044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-07db7b0e-8ed9-4ab7-b323-7e6d8217608b tempest-VolumesDeleteCascade-1670055061 None] Created volume successfully. Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Creating offline snapshot fe217d8f-61f9-460f-9f1c-9035028cf0e3 of volume 997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[928b4c4e-24ad-4bf1-b6e6-88a8898bea20]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:05 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:05 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:05 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.456s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:05 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 1G Aug 26 00:08:05 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:06 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 1G" returned: 0 in 0.482s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:06 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:06 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:06 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:06 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 is being set with open permissions: ugo+rw Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:06 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:06 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:06 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.336s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:06 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info Aug 26 00:08:06 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:07 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:07 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info is being set with open permissions: ugo+rw Aug 26 00:08:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:07 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info Aug 26 00:08:07 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:07 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.info" returned: 0 in 0.396s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7f6add77-e5e5-4ddd-9279-e884ddf07b23 tempest-VolumesDeleteCascade-1670055061 None] Create snapshot completed successfully Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (0894467d-7ff5-432d-a72d-79064f5e53be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17257306-98c8-41e7-803b-2dbb766da088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17257306-98c8-41e7-803b-2dbb766da088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1701360103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75bce272-2711-4011-8866-14555fe1713d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3601188068c24422b360b62d9ca52abb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe217d8f-61f9-460f-9f1c-9035028cf0e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:09Z,use_quota=True,user_id='eb7bcad1a0c84e0f94d74fc21dc968c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47b0121-0bd5-4619-9c6c-07d096d2eda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47b0121-0bd5-4619-9c6c-07d096d2eda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc8d9f6-596c-4fdf-a52c-1104ca081d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc8d9f6-596c-4fdf-a52c-1104ca081d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75bce272-2711-4011-8866-14555fe1713d', 'volume_name': 'volume-75bce272-2711-4011-8866-14555fe1713d', 'volume_size': 1, 'snapshot_id': 'fe217d8f-61f9-460f-9f1c-9035028cf0e3'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a202021e-c32a-441d-891f-f94879b32251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a202021e-c32a-441d-891f-f94879b32251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00bfe7d-449c-49ca-8a67-00222955c9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Volume 75bce272-2711-4011-8866-14555fe1713d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75bce272-2711-4011-8866-14555fe1713d', 'volume_size': 1, 'snapshot_id': 'fe217d8f-61f9-460f-9f1c-9035028cf0e3'} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3-75bce272-2711-4011-8866-14555fe1713d" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3-75bce272-2711-4011-8866-14555fe1713d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Creating volume 75bce272-2711-4011-8866-14555fe1713d from snapshot fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] snapshot: fe217d8f-61f9-460f-9f1c-9035028cf0e3, volume: 75bce272-2711-4011-8866-14555fe1713d, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c567f-f3e9-487c-b64c-ddbbf7523b34]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:10 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:10 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:10 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.600s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[486287ab-2da1-4c72-8bb9-2ef6c0818883]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:10 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:10 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:11 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.480s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:08:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:08:11 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:08:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:11 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d Aug 26 00:08:11 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9e0b6eae-4aef-40fe-9baf-43d5af05db7c req-3cc39fd1-7870-45af-883f-f1e23fb63c3c tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:17 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d" returned: 0 in 6.810s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:17 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:08:17 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Converted 1024.00 MB image at 150.33 MB/s Aug 26 00:08:17 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d is being set with open permissions: ugo+rw Aug 26 00:08:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:17 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d Aug 26 00:08:17 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:18 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" released by "_copy_volume_from_snapshot" :: held 8.488s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3-75bce272-2711-4011-8866-14555fe1713d" released by "_create_volume_from_snapshot" :: held 8.600s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.624s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9e0b6eae-4aef-40fe-9baf-43d5af05db7c req-3cc39fd1-7870-45af-883f-f1e23fb63c3c tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.799s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9e0b6eae-4aef-40fe-9baf-43d5af05db7c req-3cc39fd1-7870-45af-883f-f1e23fb63c3c tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00bfe7d-449c-49ca-8a67-00222955c9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75bce272-2711-4011-8866-14555fe1713d', 'volume_size': 1, 'snapshot_id': 'fe217d8f-61f9-460f-9f1c-9035028cf0e3'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249558f1-4dbd-4007-9599-5037c9e2bfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Volume volume-75bce272-2711-4011-8866-14555fe1713d (75bce272-2711-4011-8866-14555fe1713d): created successfully Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (249558f1-4dbd-4007-9599-5037c9e2bfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Flow 'volume_create_manager' (0894467d-7ff5-432d-a72d-79064f5e53be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-9e0b6eae-4aef-40fe-9baf-43d5af05db7c req-3cc39fd1-7870-45af-883f-f1e23fb63c3c tempest-TaggedAttachmentsTest-1389893232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-8d07d73a-da13-4735-8017-7eb9b62494a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee4812c7-78ae-4841-9607-a0762d9c68c0', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:08:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2b3fe0b0-a922-40b7-a233-cf477939e755 tempest-VolumesDeleteCascade-1670055061 None] Created volume successfully. Aug 26 00:08:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9e0b6eae-4aef-40fe-9baf-43d5af05db7c req-3cc39fd1-7870-45af-883f-f1e23fb63c3c tempest-TaggedAttachmentsTest-1389893232 None] attachment_update completed successfully. Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-997724b0-8f24-4d48-b833-b4bdf5ba55ed-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-997724b0-8f24-4d48-b833-b4bdf5ba55ed-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Performing cascade delete. {{(pid=94433) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-fe217d8f-61f9-460f-9f1c-9035028cf0e3-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-fe217d8f-61f9-460f-9f1c-9035028cf0e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Deleting offline snapshot fe217d8f-61f9-460f-9f1c-9035028cf0e3 of volume 997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] snapshot_file for this snap is: volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4759c074-baad-4d8b-a18f-0cc02adfb0de]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:19 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:19 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:19 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.494s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[97edd36b-1972-483f-99bc-e87e8d3f8ec9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:19 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:19 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:20 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.695s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:20 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:20 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:20 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.441s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:20 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3 Aug 26 00:08:20 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:21 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed.fe217d8f-61f9-460f-9f1c-9035028cf0e3" returned: 0 in 0.324s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-fe217d8f-61f9-460f-9f1c-9035028cf0e3" released by "_delete_snapshot" :: held 2.128s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" released by "delete_snapshot" :: held 2.170s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['b455e080-8d45-41eb-b5d9-5a9e99c7b641', 'd895cf6d-9d44-4ce9-9e96-2c7b4529f480', '0a5d7f09-5e26-46dc-b037-5c755fa8b897', '5d055502-9076-4b0a-9deb-dbc71473d9a4'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Delete snapshot completed successfully. Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-fe217d8f-61f9-460f-9f1c-9035028cf0e3-delete_snapshot" released by "delete_snapshot" :: held 2.419s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Snapshots deleted, issuing volume delete {{(pid=94433) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f537040-c068-439b-bc3a-7154ff5df9f0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:21 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:21 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-1395e0da-7533-4cc4-a076-e9257ffea1df req-da955632-5db4-43a1-ad9f-edfdbed87a5f tempest-TaggedAttachmentsTest-1389893232 None] Terminate volume connection completed successfully. Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-1395e0da-7533-4cc4-a076-e9257ffea1df req-da955632-5db4-43a1-ad9f-edfdbed87a5f tempest-TaggedAttachmentsTest-1389893232 None] Deleting attachment ee4812c7-78ae-4841-9607-a0762d9c68c0. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:08:22 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.516s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:22 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed Aug 26 00:08:22 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:22 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-997724b0-8f24-4d48-b833-b4bdf5ba55ed" returned: 0 in 0.413s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-997724b0-8f24-4d48-b833-b4bdf5ba55ed" released by "delete_volume" :: held 1.040s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['6cfdfc3a-8d7f-4e55-8f20-2dc96d910f20', 'ebe852a6-26ec-4881-95d0-db2327655991', '8085fec6-1cd0-4bf0-987a-8e48d873cb72', 'f6e89efa-1c07-4d41-acc0-e4e45871f6d2'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:22 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:22 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:23 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Deleted volume successfully. Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e98469f9-63c9-4873-9079-fd574169e6cb tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-997724b0-8f24-4d48-b833-b4bdf5ba55ed-delete_volume" released by "delete_volume" :: held 4.319s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-75bce272-2711-4011-8866-14555fe1713d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-75bce272-2711-4011-8866-14555fe1713d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b0e44-9485-482c-8f02-bc28567d836b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:23 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d Aug 26 00:08:23 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:24 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d" returned: 0 in 0.555s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:24 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d Aug 26 00:08:24 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:24 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-75bce272-2711-4011-8866-14555fe1713d" returned: 0 in 0.397s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-quobyte-75bce272-2711-4011-8866-14555fe1713d" released by "delete_volume" :: held 1.030s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Created reservations ['d4c5f21b-802f-4a17-be5c-b18ac1140536', '5c8d2893-844f-4bd9-afbb-91e4f8eb2598', '7edbb4da-1b61-40c2-bf39-05d6ffa989d5', 'bb8a79f7-8359-4e81-ae83-0faec1d6e400'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-0860a7f5-8da1-4d56-99a2-3336757ce8ee req-bc5f1c5a-8040-42f5-86d5-4561995ba714 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-0860a7f5-8da1-4d56-99a2-3336757ce8ee req-bc5f1c5a-8040-42f5-86d5-4561995ba714 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-0860a7f5-8da1-4d56-99a2-3336757ce8ee req-bc5f1c5a-8040-42f5-86d5-4561995ba714 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:24 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:24 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-0860a7f5-8da1-4d56-99a2-3336757ce8ee req-bc5f1c5a-8040-42f5-86d5-4561995ba714 tempest-ServerActionsTestOtherA-1604735046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-0a6382bc-59d0-4890-9366-898c7b47f75c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0ece665-3a85-4416-888f-0f8e01d5fb1e', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:08:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-0860a7f5-8da1-4d56-99a2-3336757ce8ee req-bc5f1c5a-8040-42f5-86d5-4561995ba714 tempest-ServerActionsTestOtherA-1604735046 None] attachment_update completed successfully. Aug 26 00:08:25 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.330s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:25 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Deleted volume successfully. Aug 26 00:08:25 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bb4f2e57-b7db-43ae-945b-33555e479d28 tempest-VolumesDeleteCascade-1670055061 None] Lock "cinder-75bce272-2711-4011-8866-14555fe1713d-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:30 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-05f21251-e33b-4cc8-94f5-caf9e492ba11 tempest-ServerActionsTestOtherA-1604735046 None] Terminate volume connection completed successfully. Aug 26 00:08:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-05f21251-e33b-4cc8-94f5-caf9e492ba11 tempest-ServerActionsTestOtherA-1604735046 None] Deleting attachment c0ece665-3a85-4416-888f-0f8e01d5fb1e. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:08:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-12d113b8-21c1-4b40-b7a4-153e1745a574 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-12d113b8-21c1-4b40-b7a4-153e1745a574 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-12d113b8-21c1-4b40-b7a4-153e1745a574 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-12d113b8-21c1-4b40-b7a4-153e1745a574 tempest-ServerActionsTestOtherA-1604735046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-0a6382bc-59d0-4890-9366-898c7b47f75c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ddfbda2-33e0-47f2-ab9e-9828b591fb62', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:08:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-c28790db-e128-4283-b6d5-d3cd4b67b72a req-12d113b8-21c1-4b40-b7a4-153e1745a574 tempest-ServerActionsTestOtherA-1604735046 None] attachment_update completed successfully. Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Flow 'volume_create_manager' (cd56859f-bd50-44e8-baba-29b8222a3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9e63bb-a04c-4645-9353-30cccfd70387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9e63bb-a04c-4645-9353-30cccfd70387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1980733572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66dfe601-bb30-436d-b31e-d82fe65d9304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d3df1e04364d8a991633968f45553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:34Z,use_quota=True,user_id='2fba3e84a2014c29ae08e7fbcf77d720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aae008-dd92-4e77-8918-151a8858a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9aae008-dd92-4e77-8918-151a8858a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3092461c-ee29-4440-ac92-d880cd04867c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3092461c-ee29-4440-ac92-d880cd04867c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66dfe601-bb30-436d-b31e-d82fe65d9304', 'volume_name': 'volume-66dfe601-bb30-436d-b31e-d82fe65d9304', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af5c7c-a281-4b3f-b026-a7fd576159da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af5c7c-a281-4b3f-b026-a7fd576159da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971a1725-10a1-4bb2-97a2-48f6b353b3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Volume 66dfe601-bb30-436d-b31e-d82fe65d9304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66dfe601-bb30-436d-b31e-d82fe65d9304', 'volume_size': 1} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1980733572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66dfe601-bb30-436d-b31e-d82fe65d9304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d3df1e04364d8a991633968f45553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:34Z,use_quota=True,user_id='2fba3e84a2014c29ae08e7fbcf77d720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Creating volume 66dfe601-bb30-436d-b31e-d82fe65d9304 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:33 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:08:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:33 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 1073741824 Aug 26 00:08:33 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:34 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 1073741824" returned: 0 in 0.649s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:34 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 Aug 26 00:08:34 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:34 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971a1725-10a1-4bb2-97a2-48f6b353b3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66dfe601-bb30-436d-b31e-d82fe65d9304', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f4f0fd-724a-462e-8d3c-4c482a6c32c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Volume volume-66dfe601-bb30-436d-b31e-d82fe65d9304 (66dfe601-bb30-436d-b31e-d82fe65d9304): created successfully Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f4f0fd-724a-462e-8d3c-4c482a6c32c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Flow 'volume_create_manager' (cd56859f-bd50-44e8-baba-29b8222a3012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f1d0284-4fe0-4896-9916-15c3165ec262 tempest-VolumesTransfersV355Test-1637258358 None] Created volume successfully. Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "cinder-8d07d73a-da13-4735-8017-7eb9b62494a7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "cinder-8d07d73a-da13-4735-8017-7eb9b62494a7-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "cinder-quobyte-8d07d73a-da13-4735-8017-7eb9b62494a7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "cinder-quobyte-8d07d73a-da13-4735-8017-7eb9b62494a7" acquired by "delete_volume" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[be64eb7a-4b9f-4d86-8ac9-97d58a4a20e1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:36 devstack sudo[99152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 Aug 26 00:08:36 devstack sudo[99152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:37 devstack sudo[99152]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7" returned: 0 in 1.108s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:37 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7 Aug 26 00:08:37 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2d9b3b95-fc5f-48d5-882d-782ce9ff21cf tempest-VolumesTransfersV355Test-1004690158 None] Transfer volume completed successfully. Aug 26 00:08:38 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d07d73a-da13-4735-8017-7eb9b62494a7" returned: 0 in 0.567s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "cinder-quobyte-8d07d73a-da13-4735-8017-7eb9b62494a7" released by "delete_volume" :: held 1.788s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Created reservations ['293dd290-ddbf-474e-9fed-035ae674d170', '3c04ac84-0ac6-4b91-b829-1cc503418a3e', '249a6a95-75c7-4c47-bc76-a1daff3ae607', '3eee60be-5fc8-4c91-b248-672a9ec595b9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:38 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:38 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "cinder-66dfe601-bb30-436d-b31e-d82fe65d9304-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-66dfe601-bb30-436d-b31e-d82fe65d9304-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "cinder-quobyte-66dfe601-bb30-436d-b31e-d82fe65d9304" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-quobyte-66dfe601-bb30-436d-b31e-d82fe65d9304" acquired by "delete_volume" :: waited 0.038s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:38 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.445s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Deleted volume successfully. Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d93785f-2970-4961-9981-9e2180068af2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de1f84d6-bdde-4b08-a396-6ac46043d271 tempest-TaggedAttachmentsTest-1389893232 None] Lock "cinder-8d07d73a-da13-4735-8017-7eb9b62494a7-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:39 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 Aug 26 00:08:39 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:39 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304" returned: 0 in 0.910s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:39 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304 Aug 26 00:08:39 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:40 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-66dfe601-bb30-436d-b31e-d82fe65d9304" returned: 0 in 0.661s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-quobyte-66dfe601-bb30-436d-b31e-d82fe65d9304" released by "delete_volume" :: held 1.669s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=78,cinder:INSERT=21,cinder:DELETE=5,cinder:UPDATE=74 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=87,cinder:SELECT=94,cinder:INSERT=18,cinder:DELETE=8 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Created reservations ['e3f39614-09c7-4d9d-8742-d4763bd8e870', 'b122ada8-3f9f-4a04-846a-36b3202e69a0', '8bd23456-70fd-4d49-b081-7d1b1a37510e', '5716eb71-e56b-454f-9d36-1c40abfc5c37'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:40 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:40 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:41 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.634s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:41 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Deleted volume successfully. Aug 26 00:08:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0c9d1e39-5927-46b6-8fc2-569195d64549 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-66dfe601-bb30-436d-b31e-d82fe65d9304-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Flow 'volume_create_manager' (e283e268-5842-49ec-8129-6077ffd2f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8d7a7-9f1d-45ae-829a-ce2d136255b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d8d7a7-9f1d-45ae-829a-ce2d136255b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-56281444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adfacaa-807f-4417-b5d5-1910f1ac7820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d3df1e04364d8a991633968f45553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:42Z,use_quota=True,user_id='2fba3e84a2014c29ae08e7fbcf77d720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b253c8e-0cc8-46a1-a062-9acdcf748614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b253c8e-0cc8-46a1-a062-9acdcf748614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac647a-4258-4bc2-b648-28e0ec45a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0ac647a-4258-4bc2-b648-28e0ec45a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7adfacaa-807f-4417-b5d5-1910f1ac7820', 'volume_name': 'volume-7adfacaa-807f-4417-b5d5-1910f1ac7820', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f258cc-7915-49aa-8995-4e406d23fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f258cc-7915-49aa-8995-4e406d23fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320bdc80-539e-4ad9-ac32-f2143960d04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:42 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Volume 7adfacaa-807f-4417-b5d5-1910f1ac7820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7adfacaa-807f-4417-b5d5-1910f1ac7820', 'volume_size': 1} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-56281444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adfacaa-807f-4417-b5d5-1910f1ac7820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19d3df1e04364d8a991633968f45553c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:42Z,use_quota=True,user_id='2fba3e84a2014c29ae08e7fbcf77d720',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Creating volume 7adfacaa-807f-4417-b5d5-1910f1ac7820 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:42 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:08:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:42 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 1073741824 Aug 26 00:08:42 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:43 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 1073741824" returned: 0 in 0.828s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:43 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 Aug 26 00:08:43 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:43 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820" returned: 0 in 0.392s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (320bdc80-539e-4ad9-ac32-f2143960d04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7adfacaa-807f-4417-b5d5-1910f1ac7820', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c71b00e-eedf-4d4c-9f9f-98b501f35271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:43 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Volume volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 (7adfacaa-807f-4417-b5d5-1910f1ac7820): created successfully Aug 26 00:08:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c71b00e-eedf-4d4c-9f9f-98b501f35271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Flow 'volume_create_manager' (e283e268-5842-49ec-8129-6077ffd2f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c7178339-508c-4fb0-baae-b5d41facef68 tempest-VolumesTransfersV355Test-1637258358 None] Created volume successfully. Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "cinder-7adfacaa-807f-4417-b5d5-1910f1ac7820-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-7adfacaa-807f-4417-b5d5-1910f1ac7820-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "cinder-quobyte-7adfacaa-807f-4417-b5d5-1910f1ac7820" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-quobyte-7adfacaa-807f-4417-b5d5-1910f1ac7820" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c4d73-8dfc-49dd-8ef7-b36bc334a7ab]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:45 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 Aug 26 00:08:45 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:45 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:45 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820 Aug 26 00:08:45 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:45 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7adfacaa-807f-4417-b5d5-1910f1ac7820" returned: 0 in 0.340s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-quobyte-7adfacaa-807f-4417-b5d5-1910f1ac7820" released by "delete_volume" :: held 0.792s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Created reservations ['b1088656-ad9a-4a5f-a9d1-50d0bc126a6c', 'bcca4216-7166-4ee9-936d-e34d1a3ec72b', 'aeed1b04-e811-4b7a-b5fd-87b0eb2c6487', 'd515ec18-314b-4464-9d64-db3685654dfd'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:46 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:46 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:46 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:08:46 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:46 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Deleted volume successfully. Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8137a7-cbfe-40f6-9be9-4928f2c687a6 tempest-VolumesTransfersV355Test-999134403 None] Lock "cinder-7adfacaa-807f-4417-b5d5-1910f1ac7820-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:08:46 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.413s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Flow 'volume_create_manager' (b29a3c1d-e2d7-4fc5-bf56-cfe94dabf7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3981e15-3793-485a-a312-7cb44a3b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3981e15-3793-485a-a312-7cb44a3b430b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-996529304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ba7a1-69cc-42df-9d1f-e69372e7cbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdfa2c76ff94fc0a26013ade3915d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:55Z,use_quota=True,user_id='011708abee2d49798832c38174f5bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f864322-dd46-4c80-8cfa-1d96df76c7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f864322-dd46-4c80-8cfa-1d96df76c7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ad1df6-5bdf-4a4c-8769-eba4fbab3fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:55 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ad1df6-5bdf-4a4c-8769-eba4fbab3fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a21ba7a1-69cc-42df-9d1f-e69372e7cbb3', 'volume_name': 'volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c15dd32-5e50-4a53-9a4d-8e3a18fb4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c15dd32-5e50-4a53-9a4d-8e3a18fb4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856c9693-a7fc-4cd8-baa0-11ee168f79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Trying to clone a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 from image 6c58b25c-448f-497b-9741-4b65985b8a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:08:56 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Image download 20.69 MB at 20.69 MB/s Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[571dd8cc-52f5-4ef7-a628-aed7ff6430a2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:56 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD Aug 26 00:08:56 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:56 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c is fetched for user 011708abee2d49798832c38174f5bc49. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc34ade5-65f1-4308-afff-e7d1da6875c9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:56 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD Aug 26 00:08:56 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:57 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-996529304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21ba7a1-69cc-42df-9d1f-e69372e7cbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdfa2c76ff94fc0a26013ade3915d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:08:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:08:55Z,use_quota=True,user_id='011708abee2d49798832c38174f5bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Creating volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:57 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1073741824 Aug 26 00:08:57 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:57 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1073741824" returned: 0 in 0.450s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:57 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 Aug 26 00:08:57 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2ea6e5d1-da8d-4307-972f-e10944519eca tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-604823529: creating Aug 26 00:08:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2ea6e5d1-da8d-4307-972f-e10944519eca tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-604823529: created successfully Aug 26 00:08:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2ea6e5d1-da8d-4307-972f-e10944519eca tempest-GroupSnapshotsTest-243374487 None] Create group completed successfully. Aug 26 00:08:57 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:57 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Attempting download of 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edba30-5e47-4fc5-9c3c-2e1af7787840]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:58 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq Aug 26 00:08:58 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:58 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq" returned: 0 in 0.347s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:58 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq Aug 26 00:08:58 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:58 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq" returned: 1 in 0.324s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_zcmdz1jq' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2e45e1-e49f-457d-866e-96ba4a483883]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:08:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:58 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD Aug 26 00:08:58 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:59 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] 6c58b25c-448f-497b-9741-4b65985b8a7c was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:59 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 Aug 26 00:08:59 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (8289d86a-1711-4f14-99f8-6769668b55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c059af0-b2ff-4129-8d45-d0d466f07f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c059af0-b2ff-4129-8d45-d0d466f07f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530333700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62bc83c4-48cc-43ba-926f-8c40a9d101d4,host='devstack@QuobyteHD#QuobyteHD',id=d4c330d7-c4ce-44d2-978a-8e0080b61b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:00Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a353d531-2954-4a25-960e-38b75dd42f7e),volume_type_id=a353d531-2954-4a25-960e-38b75dd42f7e)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b315b6-7867-4544-a095-c8c89c296b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0b315b6-7867-4544-a095-c8c89c296b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6871ef27-5b5b-4d51-9ba4-469b0b4aeaa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6871ef27-5b5b-4d51-9ba4-469b0b4aeaa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c330d7-c4ce-44d2-978a-8e0080b61b6a', 'volume_name': 'volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad29d0a-ec05-4070-8afb-80e6385bb44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad29d0a-ec05-4070-8afb-80e6385bb44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84efbe89-ade4-4639-b6d0-6174dc791b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:08:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Volume d4c330d7-c4ce-44d2-978a-8e0080b61b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a', 'volume_size': 1} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62bc83c4-48cc-43ba-926f-8c40a9d101d4,created_at=2026-08-25T22:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-530333700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62bc83c4-48cc-43ba-926f-8c40a9d101d4,host='devstack@QuobyteHD#QuobyteHD',id=d4c330d7-c4ce-44d2-978a-8e0080b61b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:00Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a353d531-2954-4a25-960e-38b75dd42f7e),volume_type_id=a353d531-2954-4a25-960e-38b75dd42f7e)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Creating volume d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:08:59 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:08:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:08:59 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a 1073741824 Aug 26 00:08:59 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:00 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a 1073741824" returned: 0 in 0.547s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:00 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:00 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:00 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.292s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84efbe89-ade4-4639-b6d0-6174dc791b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404a3c68-d4ff-4a05-b081-4013e0c11442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Volume volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a (d4c330d7-c4ce-44d2-978a-8e0080b61b6a): created successfully Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (404a3c68-d4ff-4a05-b081-4013e0c11442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (8289d86a-1711-4f14-99f8-6769668b55e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-aa15b2df-de1b-41ce-bd40-be2237d4a5df tempest-GroupSnapshotsTest-243374487 None] Created volume successfully. Aug 26 00:09:01 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" returned: 0 in 1.955s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_o7clhxrgdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:09:01 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Converted 112.00 MB image at 57.27 MB/s Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:01 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1G Aug 26 00:09:01 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] GroupSnapshot 0557796c-474c-4360-b892-7e649983030e: creating. Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Group snapshot 0557796c-474c-4360-b892-7e649983030e: creating. {{(pid=94433) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Creating offline snapshot 58f59998-af2a-4e55-a3a8-d71a09c040ff of volume d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b64ebea-e7d4-43b4-8b95-22f9df6b85f3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:01 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:01 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:01 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 1G" returned: 0 in 0.344s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Downloaded image 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c for user 011708abee2d49798832c38174f5bc49 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Marking volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Copying metadata from image 6c58b25c-448f-497b-9741-4b65985b8a7c to a21ba7a1-69cc-42df-9d1f-e69372e7cbb3. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Creating volume glance metadata for volume a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 backed by image 6c58b25c-448f-497b-9741-4b65985b8a7c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (856c9693-a7fc-4cd8-baa0-11ee168f79c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa6603-16bc-43e9-982e-cccaeb41ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Volume volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 (a21ba7a1-69cc-42df-9d1f-e69372e7cbb3): created successfully Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98aa6603-16bc-43e9-982e-cccaeb41ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Flow 'volume_create_manager' (b29a3c1d-e2d7-4fc5-bf56-cfe94dabf7b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-17196337-5981-4b51-ad2f-5c4d1a06271a tempest-VolumesExtendTest-357081986 None] Created volume successfully. Aug 26 00:09:01 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:01 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff 1G Aug 26 00:09:01 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:02 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff 1G" returned: 0 in 0.447s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:02 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:02 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:02 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:02 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:02 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:02 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:02 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:02 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info Aug 26 00:09:02 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:03 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:03 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:03 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info Aug 26 00:09:03 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:03 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.info" returned: 0 in 0.341s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.176s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.551s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1445a4-d18e-4d00-9cba-bc33fa91a71c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c9e0a21e-da75-4e48-b2aa-5517119c16f0 tempest-GroupSnapshotsTest-243374487 None] group_snapshot 0557796c-474c-4360-b892-7e649983030e: created successfully Aug 26 00:09:03 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 Aug 26 00:09:03 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:03 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" returned: 0 in 0.500s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 2G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-d94fd63d-37bc-490b-a90b-a765be673a6f req-060bb229-77fd-418c-a508-1979b57572f4 tempest-ServerActionsTestOtherA-1604735046 None] Terminate volume connection completed successfully. Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-d94fd63d-37bc-490b-a90b-a765be673a6f req-060bb229-77fd-418c-a508-1979b57572f4 tempest-ServerActionsTestOtherA-1604735046 None] Deleting attachment 7ddfbda2-33e0-47f2-ab9e-9828b591fb62. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 2G" returned: 0 in 0.175s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.719s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-732674d7-581d-4dde-b931-f9e7d7583e82 tempest-VolumesExtendTest-357081986 None] Extend volume completed successfully. Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Flow 'volume_create_manager' (06b377bd-63f3-4c8f-a6f6-9282d87f5ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722235ae-ef95-4e0c-b6bd-97a52d09053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (722235ae-ef95-4e0c-b6bd-97a52d09053f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-781115909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e83d98-7c0c-4f9b-9ce9-dbcd3212967a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b193896d79ea4567ae2220b7f844fde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:04Z,use_quota=True,user_id='eefc4063e0674007a41b0f148eeed216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9c0d5-abd6-4b36-91ec-48e9a447c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc9c0d5-abd6-4b36-91ec-48e9a447c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5942c8-50dd-455e-b093-7b30445ccaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c5942c8-50dd-455e-b093-7b30445ccaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34e83d98-7c0c-4f9b-9ce9-dbcd3212967a', 'volume_name': 'volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25849da7-1e78-4931-9b07-e25f101b881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25849da7-1e78-4931-9b07-e25f101b881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5db542-30f1-434f-b534-fc0c18bea7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:04 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Volume 34e83d98-7c0c-4f9b-9ce9-dbcd3212967a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a', 'volume_size': 1} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-781115909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34e83d98-7c0c-4f9b-9ce9-dbcd3212967a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b193896d79ea4567ae2220b7f844fde5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:04Z,use_quota=True,user_id='eefc4063e0674007a41b0f148eeed216',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Creating volume 34e83d98-7c0c-4f9b-9ce9-dbcd3212967a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:04 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:04 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a 1073741824 Aug 26 00:09:04 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:05 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a 1073741824" returned: 0 in 0.574s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:05 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a Aug 26 00:09:05 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "cinder-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-quobyte-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:05 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0d1895-1747-4dd1-ae3e-2a7972793cfc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.422s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be5db542-30f1-434f-b534-fc0c18bea7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0bc3ef-9bca-44be-9521-3be67e68f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" acquired by "_create_volume_from_snapshot" :: waited 0.109s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Creating volume fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab from snapshot 58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:05 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Volume volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a (34e83d98-7c0c-4f9b-9ce9-dbcd3212967a): created successfully Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae0bc3ef-9bca-44be-9521-3be67e68f113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Flow 'volume_create_manager' (06b377bd-63f3-4c8f-a6f6-9282d87f5ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:05 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 Aug 26 00:09:05 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" acquired by "_copy_volume_from_snapshot" :: waited 0.070s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] snapshot: 58f59998-af2a-4e55-a3a8-d71a09c040ff, volume: fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:09:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-85ac6e56-0c66-4a18-845f-986d528a0344 tempest-AttachVolumeShelveTestJSON-813902958 None] Created volume successfully. Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[32335115-c553-40ba-992c-6b4d630a7535]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:06 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:06 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:06 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" returned: 0 in 0.497s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:06 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3 Aug 26 00:09:06 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:06 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.454s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6663c290-db08-478f-a848-e2fd507a785e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:06 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" returned: 0 in 0.344s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3" released by "delete_volume" :: held 0.920s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:06 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:06 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Created reservations ['57bf5d63-fcb6-40d3-807a-4448df77369c', 'dcccbbdc-3200-4bdf-a2e7-5d0beb95504a', 'f3f58e47-7230-4098-91fa-c46db0bcfb62', 'b687cb9b-e81e-48e8-ba17-137ecd08a525'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:06 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:06 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:06 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.556s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:07 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab Aug 26 00:09:07 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:07 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Deleted volume successfully. Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d010152-4be8-4a9b-a671-ca22df01ba08 tempest-VolumesExtendTest-357081986 None] Lock "cinder-a21ba7a1-69cc-42df-9d1f-e69372e7cbb3-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Flow 'volume_create_manager' (aeb8bec5-a273-496d-b4fc-45376af6da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c623bb-0d1c-46b9-b037-b1cccf30df56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c623bb-0d1c-46b9-b037-b1cccf30df56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-643118266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bd1478-f6e5-4974-b851-0aed36fd95bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdfa2c76ff94fc0a26013ade3915d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:07Z,use_quota=True,user_id='011708abee2d49798832c38174f5bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a9bb1a-02b1-453a-b800-ff7e77accde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38a9bb1a-02b1-453a-b800-ff7e77accde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e525162-73ed-4e97-9eff-bed9f2e3015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e525162-73ed-4e97-9eff-bed9f2e3015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bd1478-f6e5-4974-b851-0aed36fd95bc', 'volume_name': 'volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a702284-80e6-4dac-bece-bd66187e9083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a702284-80e6-4dac-bece-bd66187e9083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cd0bdb-e378-4570-9f1f-d3159daa0fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Volume a7bd1478-f6e5-4974-b851-0aed36fd95bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc', 'volume_size': 1} Aug 26 00:09:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:13 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" returned: 0 in 6.117s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:09:13 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Converted 1024.00 MB image at 167.38 MB/s Aug 26 00:09:13 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:13 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab Aug 26 00:09:13 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:13 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" released by "_copy_volume_from_snapshot" :: held 7.574s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" released by "_create_volume_from_snapshot" :: held 7.717s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.827s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.777s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-643118266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bd1478-f6e5-4974-b851-0aed36fd95bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfdfa2c76ff94fc0a26013ade3915d56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:07Z,use_quota=True,user_id='011708abee2d49798832c38174f5bc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Creating volume a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:13 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:13 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc 1073741824 Aug 26 00:09:13 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f6e4e29-e410-46ce-8e46-ef51bb93b213 tempest-GroupSnapshotsTest-243374487 None] Create group from source-snapshot-0557796c-474c-4360-b892-7e649983030e completed successfully. Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Flow 'volume_create_manager' (f56c472e-ce93-406e-a304-2998ecea1980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3614b7-3636-44f2-9e3b-e5937dbeecba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3614b7-3636-44f2-9e3b-e5937dbeecba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-755649162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84678bf-c010-4c05-8d15-a8f312f0c35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acd17ede4ea4128ad405dc5d3adca9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:14Z,use_quota=True,user_id='35703c3025c6467eac947256adbb18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec004294-cf0c-47cc-9cbd-e327b74fd245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec004294-cf0c-47cc-9cbd-e327b74fd245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c8c95-7ae9-4a49-b62b-7ea8af68c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:13 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:09:14 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc 1073741824" returned: 0 in 0.575s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f06c8c95-7ae9-4a49-b62b-7ea8af68c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a84678bf-c010-4c05-8d15-a8f312f0c35c', 'volume_name': 'volume-a84678bf-c010-4c05-8d15-a8f312f0c35c', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5a54ea-760b-4a7b-89d6-5a56fd107333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e5a54ea-760b-4a7b-89d6-5a56fd107333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee388e6-4a6f-420c-bb56-2c6dc26353b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Volume a84678bf-c010-4c05-8d15-a8f312f0c35c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a84678bf-c010-4c05-8d15-a8f312f0c35c', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Trying to clone a84678bf-c010-4c05-8d15-a8f312f0c35c from image 6c58b25c-448f-497b-9741-4b65985b8a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:14 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:14 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:14 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89cd0bdb-e378-4570-9f1f-d3159daa0fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d167634-ede8-4a8f-9914-fe8579df8caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Volume volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc (a7bd1478-f6e5-4974-b851-0aed36fd95bc): created successfully Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d167634-ede8-4a8f-9914-fe8579df8caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Flow 'volume_create_manager' (aeb8bec5-a273-496d-b4fc-45376af6da73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-69c7098d-3cb7-4bc7-b766-a31c65894526 tempest-VolumesExtendTest-357081986 None] Created volume successfully. Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:09:14 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Image download 20.69 MB at 20.69 MB/s Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3678c2-66fb-4fce-a4c4-409a0193dac4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c0e5e-7599-4121-9c5f-6f3bf819e1d1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:14 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab Aug 26 00:09:14 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:14 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD Aug 26 00:09:14 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:15 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" returned: 0 in 0.433s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:15 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab Aug 26 00:09:15 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:15 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c is fetched for user 35703c3025c6467eac947256adbb18d9. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e45696-d6ed-44cc-b156-f9e1a83ab5a0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:15 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD Aug 26 00:09:15 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:15 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" returned: 0 in 0.320s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-fbebda47-7c4e-4d3c-8f15-a2e8af84f3ab" released by "delete_volume" :: held 0.836s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['258be349-c6de-4e65-bc1f-9a6d69564374'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:15 devstack cinder-volume[94433]: WARNING cinder.quota [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1088665666 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1088665666, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:15 devstack cinder-volume[94433]: WARNING cinder.quota [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1088665666 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1088665666, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Creating offline snapshot 93e908ef-b5e0-4471-a35b-328768f50a63 of volume a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2e02c4-914c-479a-a6ef-585b4853fee9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:15 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['bdb1ae1b-f042-4bca-80d6-3c4cd61558ef', '7964ae3d-4a2e-4417-ba2b-1e0a7c768e3f', '850b72e4-c719-42e7-8949-cd8e85708819', '34f0b0b6-7f76-4d5a-adec-a95bba45bbba'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:15 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:15 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:16 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:16 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:16 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:16 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 1G Aug 26 00:09:16 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:16 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f6a4d5b-8ec5-40dd-94e8-3a31ffc87171 tempest-GroupSnapshotsTest-243374487 None] Delete group completed successfully. Aug 26 00:09:16 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 1G" returned: 0 in 0.446s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:16 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 Aug 26 00:09:16 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:16 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:16 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 is being set with open permissions: ugo+rw Aug 26 00:09:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:16 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 Aug 26 00:09:16 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] group_snapshot 0557796c-474c-4360-b892-7e649983030e: deleting Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] group_snapshot 0557796c-474c-4360-b892-7e649983030e: deleting {{(pid=94433) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 00:09:17 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63" returned: 0 in 0.357s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Deleting offline snapshot 58f59998-af2a-4e55-a3a8-d71a09c040ff of volume d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] snapshot_file for this snap is: volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[904eece5-4656-489a-925d-24a2475b56eb]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:17 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info Aug 26 00:09:17 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:17 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:17 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:17 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info" returned: 0 in 0.445s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:17 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info is being set with open permissions: ugo+rw Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:17 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info Aug 26 00:09:17 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:17 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.491s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a20921-4212-464b-a53f-1c3d48e1fb1c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:18 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:18 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:18 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.info" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.490s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-755649162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a84678bf-c010-4c05-8d15-a8f312f0c35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0acd17ede4ea4128ad405dc5d3adca9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:14Z,use_quota=True,user_id='35703c3025c6467eac947256adbb18d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Creating volume a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:18 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:18 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1073741824 Aug 26 00:09:18 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ed57917a-9a2b-43a4-9c41-44795ddc485e tempest-VolumesExtendTest-357081986 None] Create snapshot completed successfully Aug 26 00:09:18 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.549s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:18 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:18 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:18 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1073741824" returned: 0 in 0.446s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:18 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c Aug 26 00:09:18 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:18 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.426s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:18 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c" returned: 0 in 0.306s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.044s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:19 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff Aug 26 00:09:19 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6286451-71b8-45b9-8427-5d8079520bb0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Attempting download of 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume a84678bf-c010-4c05-8d15-a8f312f0c35c. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319a2f5-370f-44d4-818d-5f35e9027edb]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:19 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:19 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:19 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms Aug 26 00:09:19 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:19 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a.58f59998-af2a-4e55-a3a8-d71a09c040ff" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-58f59998-af2a-4e55-a3a8-d71a09c040ff" released by "_delete_snapshot" :: held 1.944s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" released by "delete_snapshot" :: held 1.992s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:19 devstack cinder-volume[94433]: WARNING cinder.quota [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1088665666 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1088665666, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] Created reservations ['52f33dc1-28c3-40d3-ac0f-117608b0bff6', '20bed43c-0c03-43e8-ad88-cab5445f5748', 'd7fa3d6a-2d2c-4803-b92a-902a0841ee55', '8be004c3-64db-431f-9931-476d3d8ddbf9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:19 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.458s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 2G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:19 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-06c5d3fe-3fdb-44ac-994c-f573be9f5fca tempest-GroupSnapshotsTest-243374487 None] group_snapshot 0557796c-474c-4360-b892-7e649983030e: deleted successfully Aug 26 00:09:19 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms Aug 26 00:09:19 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 2G" returned: 0 in 0.174s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-600c71bf-c5f7-4d50-8abf-607e7d84c3a7 tempest-VolumesExtendTest-357081986 None] Extend volume completed successfully. Aug 26 00:09:19 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms" returned: 1 in 0.377s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_10s4jqms' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[61890d1c-d4dd-4313-8f91-c0805111afde]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:20 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD Aug 26 00:09:20 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[978744fe-276a-4d02-bd4f-4e6a05e6d2d7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-fc72fba5-e036-4d40-88c9-caa937f814fe req-b619141f-4c3b-499f-b8a3-64b69df6e4b7 tempest-AttachVolumeShelveTestJSON-813902958 None] No connector for attachment c41be442-6f32-40f5-9802-84f360f13107; skipping storage backend terminate_connection call. {{(pid=94433) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-fc72fba5-e036-4d40-88c9-caa937f814fe req-b619141f-4c3b-499f-b8a3-64b69df6e4b7 tempest-AttachVolumeShelveTestJSON-813902958 None] Deleting attachment c41be442-6f32-40f5-9802-84f360f13107. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-93e908ef-b5e0-4471-a35b-328768f50a63-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-93e908ef-b5e0-4471-a35b-328768f50a63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:20 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:20 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-quobyte-93e908ef-b5e0-4471-a35b-328768f50a63" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-93e908ef-b5e0-4471-a35b-328768f50a63" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:20 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Deleting offline snapshot 93e908ef-b5e0-4471-a35b-328768f50a63 of volume a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] snapshot_file for this snap is: volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD" returned: 0 in 0.473s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] 6c58b25c-448f-497b-9741-4b65985b8a7c was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9068c214-79e3-466a-929c-19f4e7b9cb6c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:20 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c Aug 26 00:09:20 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:20 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 Aug 26 00:09:20 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:20 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.490s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:20 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a Aug 26 00:09:20 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:20 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:20 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63" returned: 0 in 0.508s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-d4c330d7-c4ce-44d2-978a-8e0080b61b6a" released by "delete_volume" :: held 0.924s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9f2d21-1167-4758-ae73-5fe40930af04]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Created reservations ['78a43485-5015-4c81-89d2-441aa4a87191'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:21 devstack cinder-volume[94433]: WARNING cinder.db.api [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1088665666'] Aug 26 00:09:21 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:21 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Created reservations ['d9138e07-3567-4a7f-b842-45f66c250041', 'c8c31a4d-1bcb-4926-b56c-63e3d3f4d1a2', '1c962680-46ed-4192-850a-55bbd2f9fad2', '870a3e60-de79-46ad-ad81-62ca5bbaed49'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:21 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:21 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:21 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.582s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:21 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 Aug 26 00:09:21 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:21 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:21 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b8ed37e8-ead3-48a5-9930-063ebbc1ac0d tempest-GroupSnapshotsTest-243374487 None] Delete group completed successfully. Aug 26 00:09:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-892d768e-43f1-4329-b11d-0e426314ffc5 tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-523913801: creating Aug 26 00:09:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-892d768e-43f1-4329-b11d-0e426314ffc5 tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-523913801: created successfully Aug 26 00:09:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-892d768e-43f1-4329-b11d-0e426314ffc5 tempest-GroupSnapshotsTest-243374487 None] Create group completed successfully. Aug 26 00:09:22 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63" returned: 0 in 0.611s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:22 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63 Aug 26 00:09:22 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:22 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc.93e908ef-b5e0-4471-a35b-328768f50a63" returned: 0 in 0.331s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-93e908ef-b5e0-4471-a35b-328768f50a63" released by "_delete_snapshot" :: held 2.220s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" released by "delete_snapshot" :: held 2.265s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Created reservations ['76fad3f9-3c86-4772-b796-d48a9391e14e', '419f43b5-2d86-4543-9195-027af022b7d9', '39ac7576-b49a-4ed3-8515-28baefa9099d', '6ef12f5b-ae80-49df-ac54-2dea21f55ddf'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Delete snapshot completed successfully. Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e60c85b3-060d-4a7c-bae8-a71436bf70af tempest-VolumesExtendTest-357081986 None] Lock "cinder-93e908ef-b5e0-4471-a35b-328768f50a63-delete_snapshot" released by "delete_snapshot" :: held 2.459s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:22 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c" returned: 0 in 2.407s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_7fxqp9m1devstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:09:22 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Converted 112.00 MB image at 46.51 MB/s Aug 26 00:09:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:22 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1G Aug 26 00:09:22 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:23 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c 1G" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Downloaded image 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume a84678bf-c010-4c05-8d15-a8f312f0c35c successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c for user 35703c3025c6467eac947256adbb18d9 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Marking volume a84678bf-c010-4c05-8d15-a8f312f0c35c as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Copying metadata from image 6c58b25c-448f-497b-9741-4b65985b8a7c to a84678bf-c010-4c05-8d15-a8f312f0c35c. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Creating volume glance metadata for volume a84678bf-c010-4c05-8d15-a8f312f0c35c backed by image 6c58b25c-448f-497b-9741-4b65985b8a7c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ee388e6-4a6f-420c-bb56-2c6dc26353b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a84678bf-c010-4c05-8d15-a8f312f0c35c', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13a644a-3867-4d13-b12f-29c2504c563b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Volume volume-a84678bf-c010-4c05-8d15-a8f312f0c35c (a84678bf-c010-4c05-8d15-a8f312f0c35c): created successfully Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d13a644a-3867-4d13-b12f-29c2504c563b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Flow 'volume_create_manager' (f56c472e-ce93-406e-a304-2998ecea1980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1ce7e7fd-95fb-402b-a6d4-1484d39b4cde tempest-ServerActionsTestOtherA-1604735046 None] Created volume successfully. Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-a7bd1478-f6e5-4974-b851-0aed36fd95bc-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "cinder-a7bd1478-f6e5-4974-b851-0aed36fd95bc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Acquiring lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6976bb0a-6a05-4f06-b998-e687e05462b0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (037f26cd-7fdc-48ee-ae99-233eae7503d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5899e83-f305-43fc-a6db-581ceff521b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5899e83-f305-43fc-a6db-581ceff521b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853910879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,host='devstack@QuobyteHD#QuobyteHD',id=305f575b-3fbb-412f-8f7a-13c504e5f21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:24Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7f16972-0c08-4a11-9111-154ecbf76789),volume_type_id=d7f16972-0c08-4a11-9111-154ecbf76789)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5eddbc-9f5f-4147-857d-60ab65cdc56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d5eddbc-9f5f-4147-857d-60ab65cdc56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cead258-e4a0-44fc-84df-77d7586dd442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cead258-e4a0-44fc-84df-77d7586dd442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '305f575b-3fbb-412f-8f7a-13c504e5f21b', 'volume_name': 'volume-305f575b-3fbb-412f-8f7a-13c504e5f21b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9112544b-6c13-49c2-9087-5bf1b443f349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9112544b-6c13-49c2-9087-5bf1b443f349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:23 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:23 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df167095-a134-4a6d-b34f-bbe175f43440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:23 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Volume 305f575b-3fbb-412f-8f7a-13c504e5f21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-305f575b-3fbb-412f-8f7a-13c504e5f21b', 'volume_size': 1} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,created_at=2026-08-25T22:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1853910879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,host='devstack@QuobyteHD#QuobyteHD',id=305f575b-3fbb-412f-8f7a-13c504e5f21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:24Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7f16972-0c08-4a11-9111-154ecbf76789),volume_type_id=d7f16972-0c08-4a11-9111-154ecbf76789)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Creating volume 305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:23 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:23 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b 1073741824 Aug 26 00:09:23 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:24 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.452s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:24 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc Aug 26 00:09:24 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:24 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b 1073741824" returned: 0 in 0.568s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:24 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b Aug 26 00:09:24 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:24 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7bd1478-f6e5-4974-b851-0aed36fd95bc" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "cinder-quobyte-a7bd1478-f6e5-4974-b851-0aed36fd95bc" released by "delete_volume" :: held 0.908s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Created reservations ['111f06c4-b95d-49ae-b0ff-c6471950ed58', 'c9f7bbd9-2e9a-4dff-a73a-f430099e6a2b', 'e09d37ca-ab65-4ea5-bb2b-583ad02eee59', '2383f6e6-6191-4cfe-b55c-0d372de81451'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:24 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:24 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:24 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df167095-a134-4a6d-b34f-bbe175f43440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-305f575b-3fbb-412f-8f7a-13c504e5f21b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c7c53b-7933-441c-a224-548dd71ea279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:24 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Volume volume-305f575b-3fbb-412f-8f7a-13c504e5f21b (305f575b-3fbb-412f-8f7a-13c504e5f21b): created successfully Aug 26 00:09:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c7c53b-7933-441c-a224-548dd71ea279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (037f26cd-7fdc-48ee-ae99-233eae7503d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6379dd29-09ee-41f3-b59d-55230b1fa7c6 tempest-GroupSnapshotsTest-243374487 None] Created volume successfully. Aug 26 00:09:25 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.430s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:25 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Deleted volume successfully. Aug 26 00:09:25 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b59587dc-a623-4ba0-8b78-d8c485d6866a tempest-VolumesExtendTest-357081986 None] Lock "cinder-a7bd1478-f6e5-4974-b851-0aed36fd95bc-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (4ad1fd1d-9e52-4a77-9933-00e3e966a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58bffe-9c0f-4064-b05c-3cedf96e324d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af58bffe-9c0f-4064-b05c-3cedf96e324d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376071873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,host='devstack@QuobyteHD#QuobyteHD',id=6cadefba-6c27-4ecf-b896-02b4c6a3a2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:27Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7f16972-0c08-4a11-9111-154ecbf76789),volume_type_id=d7f16972-0c08-4a11-9111-154ecbf76789)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9da5404-9db6-4c5c-97f5-7d91a97e6da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9da5404-9db6-4c5c-97f5-7d91a97e6da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7405b06-3a06-4951-b034-33c902f03a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7405b06-3a06-4951-b034-33c902f03a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cadefba-6c27-4ecf-b896-02b4c6a3a2cd', 'volume_name': 'volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e177d97-20f6-4886-aae2-96721c2ef6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e177d97-20f6-4886-aae2-96721c2ef6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b95f34-64ca-4509-b2c1-a49cab90242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:27 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Volume 6cadefba-6c27-4ecf-b896-02b4c6a3a2cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd', 'volume_size': 1} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,created_at=2026-08-25T22:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1376071873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5b0f418d-63c2-4fec-bacf-801417ae9b70,host='devstack@QuobyteHD#QuobyteHD',id=6cadefba-6c27-4ecf-b896-02b4c6a3a2cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:27Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7f16972-0c08-4a11-9111-154ecbf76789),volume_type_id=d7f16972-0c08-4a11-9111-154ecbf76789)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Creating volume 6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:27 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:27 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd 1073741824 Aug 26 00:09:27 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:28 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd 1073741824" returned: 0 in 0.751s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-e2655f66-67f7-49d1-b067-6b40fba87393 req-310a4db3-3168-43c7-8289-2d3fdf51960a tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:28 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd Aug 26 00:09:28 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:28 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-e2655f66-67f7-49d1-b067-6b40fba87393 req-310a4db3-3168-43c7-8289-2d3fdf51960a tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.385s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b95f34-64ca-4509-b2c1-a49cab90242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f6e207-5e29-4e93-9c9d-f004575fd49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-e2655f66-67f7-49d1-b067-6b40fba87393 req-310a4db3-3168-43c7-8289-2d3fdf51960a tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Volume volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd (6cadefba-6c27-4ecf-b896-02b4c6a3a2cd): created successfully Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2f6e207-5e29-4e93-9c9d-f004575fd49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (4ad1fd1d-9e52-4a77-9933-00e3e966a40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-785d82ac-8506-452d-8139-fda066dde287 tempest-GroupSnapshotsTest-243374487 None] Created volume successfully. Aug 26 00:09:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-e2655f66-67f7-49d1-b067-6b40fba87393 req-310a4db3-3168-43c7-8289-2d3fdf51960a tempest-ServerActionsTestOtherA-1604735046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-a84678bf-c010-4c05-8d15-a8f312f0c35c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe003c47-73dd-4e09-8249-83e42ba151d4', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:09:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-e2655f66-67f7-49d1-b067-6b40fba87393 req-310a4db3-3168-43c7-8289-2d3fdf51960a tempest-ServerActionsTestOtherA-1604735046 None] attachment_update completed successfully. Aug 26 00:09:30 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b7311f8c-ec2b-4082-a8a2-75cb83b5d18b tempest-GroupSnapshotsTest-243374487 None] Update group completed successfully. Aug 26 00:09:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-863e0959-cb0d-483e-80cf-72b8d2b2fa31 tempest-GroupSnapshotsTest-243374487 None] Update group completed successfully. Aug 26 00:09:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a93d1e66-46ef-4cb7-88d3-f1000dca71cc tempest-GroupSnapshotsTest-243374487 None] Update group completed successfully. Aug 26 00:09:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8a5da84a-3213-4231-8a93-e21a6fc6d311 tempest-GroupSnapshotsTest-243374487 None] Update group completed successfully. Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (a8287ff7-1608-4fe7-88bb-4617a99ffa6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704c984-a30c-4ab5-bff2-b7c2f4e80bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0704c984-a30c-4ab5-bff2-b7c2f4e80bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1930153174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19c27a5-3cbd-4d1e-be06-865c6f9cf981,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:34Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640c5138-19fd-4328-9f59-604d25f85dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640c5138-19fd-4328-9f59-604d25f85dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6ece0d-03af-4f7d-a282-bb15b3e954be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c6ece0d-03af-4f7d-a282-bb15b3e954be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19c27a5-3cbd-4d1e-be06-865c6f9cf981', 'volume_name': 'volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee171e-95e2-43e2-a2f3-a45dec7976b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee171e-95e2-43e2-a2f3-a45dec7976b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f21eb1-9db9-4124-b40e-a4a0f375ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Volume e19c27a5-3cbd-4d1e-be06-865c6f9cf981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981', 'volume_size': 1} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1930153174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19c27a5-3cbd-4d1e-be06-865c6f9cf981,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:34Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Creating volume e19c27a5-3cbd-4d1e-be06-865c6f9cf981 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:34 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:34 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 1073741824 Aug 26 00:09:34 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:35 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 1073741824" returned: 0 in 0.684s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:35 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 Aug 26 00:09:35 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:35 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" returned: 0 in 0.683s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f21eb1-9db9-4124-b40e-a4a0f375ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2710b07-e266-47a5-b9ef-ca0869933527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Volume volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 (e19c27a5-3cbd-4d1e-be06-865c6f9cf981): created successfully Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2710b07-e266-47a5-b9ef-ca0869933527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (a8287ff7-1608-4fe7-88bb-4617a99ffa6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] GroupSnapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: creating. Aug 26 00:09:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-42652540-9060-49b6-9c97-3b0fae06ac18 tempest-VolumesListTestJSON-1999006932 None] Created volume successfully. Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Group snapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: creating. {{(pid=94433) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Creating offline snapshot 9e54486e-d976-4e8f-b7bc-fee3dae033c4 of volume 6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a22ba-209f-43ff-864a-95c7c5a12c28]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:36 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd Aug 26 00:09:36 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:37 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" returned: 0 in 0.811s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:37 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 1G Aug 26 00:09:37 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (83860932-3963-4e89-8976-fc5f62398e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33291a6c-ab34-49ab-9115-d8da8c9b9d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33291a6c-ab34-49ab-9115-d8da8c9b9d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404441806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7483145-b676-4b06-b597-68bbff838fde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:38Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba58649-6669-42ef-b005-5eeeba02414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ba58649-6669-42ef-b005-5eeeba02414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94819829-bd83-4975-b677-87bf1f116bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94819829-bd83-4975-b677-87bf1f116bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7483145-b676-4b06-b597-68bbff838fde', 'volume_name': 'volume-a7483145-b676-4b06-b597-68bbff838fde', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1343b0b8-08fd-482f-a985-5fb6875b8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:37 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1343b0b8-08fd-482f-a985-5fb6875b8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1160b1-d48e-437c-8fd8-d4468dca4efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Volume a7483145-b676-4b06-b597-68bbff838fde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7483145-b676-4b06-b597-68bbff838fde', 'volume_size': 1} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 1G" returned: 0 in 0.804s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:38 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 Aug 26 00:09:38 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:38 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:38 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:38 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 Aug 26 00:09:38 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:38 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:38 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info Aug 26 00:09:38 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:39 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info" returned: 0 in 0.355s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:39 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:39 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info Aug 26 00:09:39 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:39 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.info" returned: 0 in 0.432s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.333s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Creating offline snapshot ac46d75f-0737-4300-a203-33ef04edd276 of volume 305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf2974-3bc8-4fd8-99d8-767fe154e918]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:39 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b Aug 26 00:09:39 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:40 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b" returned: 0 in 0.611s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:40 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 1G Aug 26 00:09:40 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:40 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 1G" returned: 0 in 0.587s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305f575b-3fbb-412f-8f7a-13c504e5f21b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:40 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305f575b-3fbb-412f-8f7a-13c504e5f21b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 Aug 26 00:09:40 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:41 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-305f575b-3fbb-412f-8f7a-13c504e5f21b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276" returned: 0 in 0.759s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:41 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:41 devstack sudo[100465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 Aug 26 00:09:41 devstack sudo[100465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:42 devstack sudo[100465]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276" returned: 0 in 0.722s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:42 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:INSERT=36,cinder:UPDATE=119,cinder:SELECT=118,cinder:DELETE=5 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:09:42 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=128,cinder:INSERT=37,cinder:UPDATE=110,cinder:DELETE=9 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:09:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:42 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info Aug 26 00:09:42 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:43 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info" returned: 0 in 0.617s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:43 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:43 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info Aug 26 00:09:43 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:43 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.info" returned: 0 in 0.388s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.909s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.548s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-404441806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7483145-b676-4b06-b597-68bbff838fde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:38Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Creating volume a7483145-b676-4b06-b597-68bbff838fde {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:43 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:43 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde 1073741824 Aug 26 00:09:43 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a813c175-ef73-44c9-b98f-02818a0ad215 tempest-GroupSnapshotsTest-243374487 None] group_snapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: created successfully Aug 26 00:09:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] group_snapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: deleting Aug 26 00:09:44 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde 1073741824" returned: 0 in 0.882s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] group_snapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: deleting {{(pid=94433) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" acquired by "delete_snapshot" :: waited 0.051s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-9e54486e-d976-4e8f-b7bc-fee3dae033c4" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-9e54486e-d976-4e8f-b7bc-fee3dae033c4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:44 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde Aug 26 00:09:44 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Deleting offline snapshot 9e54486e-d976-4e8f-b7bc-fee3dae033c4 of volume 6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] snapshot_file for this snap is: volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8f7107-ad3f-4085-93ac-ca99d8b655e2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:44 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 Aug 26 00:09:44 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:45 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde" returned: 0 in 0.857s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af1160b1-d48e-437c-8fd8-d4468dca4efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7483145-b676-4b06-b597-68bbff838fde', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:45 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6046f3e-9aba-4148-bee8-5c570f947330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4" returned: 0 in 0.925s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:09:45 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Volume volume-a7483145-b676-4b06-b597-68bbff838fde (a7483145-b676-4b06-b597-68bbff838fde): created successfully Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6046f3e-9aba-4148-bee8-5c570f947330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (83860932-3963-4e89-8976-fc5f62398e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[add01a21-835e-45ca-b84d-2e61b6acf68e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bac1d738-4293-4226-9c0e-032fce5b953b tempest-VolumesListTestJSON-1999006932 None] Created volume successfully. Aug 26 00:09:45 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd Aug 26 00:09:45 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:46 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" returned: 0 in 0.387s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:46 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 Aug 26 00:09:46 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:46 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:46 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4 Aug 26 00:09:46 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:09:46 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd.9e54486e-d976-4e8f-b7bc-fee3dae033c4" returned: 0 in 0.313s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-9e54486e-d976-4e8f-b7bc-fee3dae033c4" released by "_delete_snapshot" :: held 2.188s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" released by "delete_snapshot" :: held 2.234s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-ac46d75f-0737-4300-a203-33ef04edd276" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-ac46d75f-0737-4300-a203-33ef04edd276" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Deleting offline snapshot ac46d75f-0737-4300-a203-33ef04edd276 of volume 305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] snapshot_file for this snap is: volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[735bc2a9-3ea3-4a3b-bea5-1c9525ec1bcd]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:47 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 Aug 26 00:09:47 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-0f6aaf0b-a295-4b44-9b60-4601af0bb308 tempest-ServerActionsTestOtherA-1604735046 None] Terminate volume connection completed successfully. Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-0f6aaf0b-a295-4b44-9b60-4601af0bb308 tempest-ServerActionsTestOtherA-1604735046 None] Deleting attachment fe003c47-73dd-4e09-8249-83e42ba151d4. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:47 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (8966c3dc-1099-4158-9661-45b3eeb216d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4db714d-b9ec-4880-90f1-25171f5ff00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276" returned: 0 in 0.943s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-305f575b-3fbb-412f-8f7a-13c504e5f21b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f23def-322f-49cf-8c59-49475465405b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4db714d-b9ec-4880-90f1-25171f5ff00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685681183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ed75f-d5b9-4dbe-a288-2718d0c83b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:48Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80547971-5a2f-4e4b-942e-397573650d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80547971-5a2f-4e4b-942e-397573650d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cea33bd-ca19-4385-bb21-d77492a0cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cea33bd-ca19-4385-bb21-d77492a0cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '713ed75f-d5b9-4dbe-a288-2718d0c83b95', 'volume_name': 'volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296b5cb-20eb-4a75-b130-cd7386cba890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3296b5cb-20eb-4a75-b130-cd7386cba890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e48f-ed0c-49ca-b9d0-1f28ff6e2d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:47 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Volume 713ed75f-d5b9-4dbe-a288-2718d0c83b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95', 'volume_size': 1} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685681183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=713ed75f-d5b9-4dbe-a288-2718d0c83b95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='311412754d0b45209d41f6e5f99f38a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:48Z,use_quota=True,user_id='098633b0531f4dc194dc2ac81f123a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Creating volume 713ed75f-d5b9-4dbe-a288-2718d0c83b95 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:47 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:48 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 1073741824 Aug 26 00:09:48 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:48 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b Aug 26 00:09:48 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:48 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b" returned: 0 in 0.686s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:48 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 Aug 26 00:09:48 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:48 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 1073741824" returned: 0 in 0.755s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:48 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 Aug 26 00:09:48 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:48 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:49 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276 Aug 26 00:09:49 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:49 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95" returned: 0 in 0.288s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b86e48f-ed0c-49ca-b9d0-1f28ff6e2d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23303ef8-5826-499a-82c2-47b7ea8120a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:49 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Volume volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 (713ed75f-d5b9-4dbe-a288-2718d0c83b95): created successfully Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23303ef8-5826-499a-82c2-47b7ea8120a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Flow 'volume_create_manager' (8966c3dc-1099-4158-9661-45b3eeb216d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3d3667a6-39f9-49a9-8943-7a6b139aa52d tempest-VolumesListTestJSON-1999006932 None] Created volume successfully. Aug 26 00:09:49 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b.ac46d75f-0737-4300-a203-33ef04edd276" returned: 0 in 0.289s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-ac46d75f-0737-4300-a203-33ef04edd276" released by "_delete_snapshot" :: held 2.494s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" released by "delete_snapshot" :: held 2.523s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:49 devstack cinder-volume[94433]: WARNING cinder.quota [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1143703104 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1143703104, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:49 devstack cinder-volume[94433]: WARNING cinder.quota [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1143703104 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1143703104, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['72785cab-1315-4ba8-b8f8-4c291a151981', '63545b32-cb90-4936-be8f-042bd4cae0c4', '307f6225-ff21-4716-a083-ae33771861ad', 'd486dac1-cb82-4bf8-8278-8e381357d1b1'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['60e2d394-7266-4e3c-8c13-88d5a5c16c9d', '238a1e1a-ab9b-4e23-9cd8-a9bb0f6c2213', '7dddd2fb-c98e-4179-98f2-08b16d8fd7cb', 'd1644fea-218e-453d-bf4e-593bb1cb8184'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0bf5dd6b-1e21-4b16-80e0-2573d7b4ef70 tempest-GroupSnapshotsTest-243374487 None] group_snapshot 2b9b61fc-9cfa-4e8b-a1d8-c0728ad6a21e: deleted successfully Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-2c949439-1a26-46be-964b-5149d2ffb1ec tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-2c949439-1a26-46be-964b-5149d2ffb1ec tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-2c949439-1a26-46be-964b-5149d2ffb1ec tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-2c949439-1a26-46be-964b-5149d2ffb1ec tempest-ServerActionsTestOtherA-1604735046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-a84678bf-c010-4c05-8d15-a8f312f0c35c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dd3cc99-c2b4-4070-b05f-824bf01c6b81', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:09:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-71e8bccc-0132-47b5-815e-01903b0ecde3 req-2c949439-1a26-46be-964b-5149d2ffb1ec tempest-ServerActionsTestOtherA-1604735046 None] attachment_update completed successfully. Aug 26 00:09:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[40723988-c3ea-4ce1-aeb5-3f57d8c7c21f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:50 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b Aug 26 00:09:50 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:51 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b" returned: 0 in 0.596s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:51 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b Aug 26 00:09:51 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:51 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-305f575b-3fbb-412f-8f7a-13c504e5f21b" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-305f575b-3fbb-412f-8f7a-13c504e5f21b" released by "delete_volume" :: held 1.247s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[586e2895-19f2-496c-9051-a817508c8c6e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:52 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd Aug 26 00:09:52 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:52 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" returned: 0 in 0.515s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:52 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd Aug 26 00:09:52 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:52 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-6cadefba-6c27-4ecf-b896-02b4c6a3a2cd" released by "delete_volume" :: held 0.873s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['7bba27ee-2bbb-4d03-a01d-8210ee857d54'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:52 devstack cinder-volume[94433]: WARNING cinder.quota [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1143703104 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1143703104, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:09:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['ddf9d65c-5234-438b-b171-9d8fbf6011b3', '7487b836-541f-4420-8c24-f04ef934bc7c', '9289accc-1c5e-4e28-b5ef-6c12db0d3282', 'cedfc153-c95c-410b-8cb2-6579aa3a90fe'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['1d7d9365-0a5c-4ba9-b99f-1847cc2fe417', '3926a2bb-b777-4f75-a169-46314e5511d2', 'f340efbf-db38-4223-93e6-9fd2b72d983d', '11746bec-5a72-4f26-9a4b-2eff0c66534a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-713ed75f-d5b9-4dbe-a288-2718d0c83b95-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:53 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:53 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-713ed75f-d5b9-4dbe-a288-2718d0c83b95-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-quobyte-713ed75f-d5b9-4dbe-a288-2718d0c83b95" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-713ed75f-d5b9-4dbe-a288-2718d0c83b95" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fb6b89-0376-4f6c-8636-44e2b8c3acaa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:53 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 Aug 26 00:09:53 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:53 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3640ac52-d00c-454a-8b0a-de594301ca31 tempest-GroupSnapshotsTest-243374487 None] Delete group completed successfully. Aug 26 00:09:53 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95" returned: 0 in 0.495s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:53 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95 Aug 26 00:09:53 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-eb7563fa-08f3-4af4-a38b-42b4defd96fc tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-925476965: creating Aug 26 00:09:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-eb7563fa-08f3-4af4-a38b-42b4defd96fc tempest-GroupSnapshotsTest-243374487 None] Group tempest-GroupSnapshotsTest-Group-925476965: created successfully Aug 26 00:09:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-eb7563fa-08f3-4af4-a38b-42b4defd96fc tempest-GroupSnapshotsTest-243374487 None] Create group completed successfully. Aug 26 00:09:54 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-713ed75f-d5b9-4dbe-a288-2718d0c83b95" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-713ed75f-d5b9-4dbe-a288-2718d0c83b95" released by "delete_volume" :: held 0.852s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Created reservations ['f512b7f0-195c-4c9f-8ccd-64169edb0d68', '075d82e1-f82e-4992-b09a-c42508d0f9b6', 'd8028767-8696-478c-bc96-b10279e1f904', '21920b29-fba5-4168-8e67-234b46c05b20'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:54 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:54 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-a7483145-b676-4b06-b597-68bbff838fde-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-a7483145-b676-4b06-b597-68bbff838fde-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-quobyte-a7483145-b676-4b06-b597-68bbff838fde" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-a7483145-b676-4b06-b597-68bbff838fde" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d8ef5-dcd5-4a20-8213-a312b371df51]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:54 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.504s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Deleted volume successfully. Aug 26 00:09:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4474b809-3f82-410a-b1bf-97b61c380c4b tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-713ed75f-d5b9-4dbe-a288-2718d0c83b95-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:54 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde Aug 26 00:09:54 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:55 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde" returned: 0 in 0.443s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:55 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde Aug 26 00:09:55 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:55 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a7483145-b676-4b06-b597-68bbff838fde" returned: 0 in 0.354s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-a7483145-b676-4b06-b597-68bbff838fde" released by "delete_volume" :: held 0.886s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Created reservations ['6bae53fe-f98b-400d-b825-29b5ac0af9c4', '6d29b9ce-ad1c-4b83-b842-453746b3826f', 'fa804c53-5bfe-47bb-8835-4e9edd1250dd', 'd8cf14a6-ff9c-44a6-920a-c3d57ba278aa'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (22cae3af-9eb7-4e37-976b-2d49d235ada8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d8ed9-8115-4cba-9fe9-4b562e9c862b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99d8ed9-8115-4cba-9fe9-4b562e9c862b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830116263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8030459f-4a44-46de-bc9b-0b18ef3d9f3b,host='devstack@QuobyteHD#QuobyteHD',id=b9fa4433-0edc-482a-962b-efaad3138e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:56Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(922ab77b-10e2-4f1c-ae41-b7a6652c220e),volume_type_id=922ab77b-10e2-4f1c-ae41-b7a6652c220e)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0cc18f-a862-41f3-99ca-f080c4f080f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0cc18f-a862-41f3-99ca-f080c4f080f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5337a16f-bdda-40dd-8d84-48558857198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5337a16f-bdda-40dd-8d84-48558857198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9fa4433-0edc-482a-962b-efaad3138e97', 'volume_name': 'volume-b9fa4433-0edc-482a-962b-efaad3138e97', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2eb33b-cd9b-4334-a330-0bd5d5a71be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2eb33b-cd9b-4334-a330-0bd5d5a71be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5729b4c-9596-47b4-80ce-2ea756123ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Volume b9fa4433-0edc-482a-962b-efaad3138e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9fa4433-0edc-482a-962b-efaad3138e97', 'volume_size': 1} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8030459f-4a44-46de-bc9b-0b18ef3d9f3b,created_at=2026-08-25T22:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-830116263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8030459f-4a44-46de-bc9b-0b18ef3d9f3b,host='devstack@QuobyteHD#QuobyteHD',id=b9fa4433-0edc-482a-962b-efaad3138e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8870280a20e14315aececdd8b4d1b00e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:09:56Z,use_quota=True,user_id='326ddc4195ca4d2caef2ceec4f57147e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(922ab77b-10e2-4f1c-ae41-b7a6652c220e),volume_type_id=922ab77b-10e2-4f1c-ae41-b7a6652c220e)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Creating volume b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:09:56 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:56 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 1073741824 Aug 26 00:09:56 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:56 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:56 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-e19c27a5-3cbd-4d1e-be06-865c6f9cf981-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-e19c27a5-3cbd-4d1e-be06-865c6f9cf981-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "cinder-quobyte-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" acquired by "delete_volume" :: waited 0.052s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[842a5db7-cc7f-4245-a869-65a5a4dfb8fc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:56 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:56 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 Aug 26 00:09:56 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.729s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Deleted volume successfully. Aug 26 00:09:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26b9f2ef-2812-4479-ae82-5db787b5e9d7 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-a7483145-b676-4b06-b597-68bbff838fde-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:57 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 1073741824" returned: 0 in 0.980s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:57 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 Aug 26 00:09:57 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:57 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" returned: 0 in 0.792s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:57 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981 Aug 26 00:09:57 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:57 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97" returned: 0 in 0.612s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5729b4c-9596-47b4-80ce-2ea756123ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9fa4433-0edc-482a-962b-efaad3138e97', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e052db-4e81-4db7-85c0-4d09885cad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:09:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Volume volume-b9fa4433-0edc-482a-962b-efaad3138e97 (b9fa4433-0edc-482a-962b-efaad3138e97): created successfully Aug 26 00:09:57 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e052db-4e81-4db7-85c0-4d09885cad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Flow 'volume_create_manager' (22cae3af-9eb7-4e37-976b-2d49d235ada8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:09:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" returned: 0 in 0.664s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-quobyte-e19c27a5-3cbd-4d1e-be06-865c6f9cf981" released by "delete_volume" :: held 1.629s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ec74fb38-09ee-403c-81e0-2be7ba63e1f2 tempest-GroupSnapshotsTest-243374487 None] Created volume successfully. Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Created reservations ['caf62bf7-17e8-455c-b1c0-d4405cc53eae', '6379f23c-de07-420e-aa0f-834889a64c45', 'ff32dd78-d3cc-4170-88b1-7cc0e663861e', 'a3bd0e23-1fa0-4d18-a9d0-c12c984551f0'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:09:58 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:09:58 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:09:58 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:09:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Deleted volume successfully. Aug 26 00:09:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f18187c-33c2-40f7-b718-81c931a99c09 tempest-VolumesListTestJSON-1999006932 None] Lock "cinder-e19c27a5-3cbd-4d1e-be06-865c6f9cf981-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:09:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] GroupSnapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: creating. Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Group snapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: creating. {{(pid=94433) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Creating offline snapshot bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 of volume b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[04819a88-d976-41b3-9a0f-81e2e0b301bc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:09:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:00 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 Aug 26 00:10:00 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:00 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97" returned: 0 in 0.714s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:00 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 1G Aug 26 00:10:00 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:01 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 1G" returned: 0 in 0.923s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fa4433-0edc-482a-962b-efaad3138e97 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:01 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fa4433-0edc-482a-962b-efaad3138e97 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 Aug 26 00:10:01 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:02 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9fa4433-0edc-482a-962b-efaad3138e97 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" returned: 0 in 0.625s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:02 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:10:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:02 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 Aug 26 00:10:02 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:02 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" returned: 0 in 0.516s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:02 devstack sudo[101608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info Aug 26 00:10:02 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:03 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info" returned: 0 in 0.475s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:03 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:10:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:03 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info Aug 26 00:10:03 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:03 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.info" returned: 0 in 0.581s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.966s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2192e75f-cd0f-46d6-8867-fc0ef44a2c1b tempest-GroupSnapshotsTest-243374487 None] group_snapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: created successfully Aug 26 00:10:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] group_snapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: deleting Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] group_snapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: deleting {{(pid=94433) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Deleting offline snapshot bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 of volume b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] snapshot_file for this snap is: volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8e5eb-452e-4c25-b406-95286fc9f13d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:05 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 Aug 26 00:10:05 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:05 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" returned: 0 in 0.744s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9fa4433-0edc-482a-962b-efaad3138e97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:10:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d15abf-40fb-4d4e-90f5-3f4a79dfdb98]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:05 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 Aug 26 00:10:05 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:06 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97" returned: 0 in 0.898s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:06 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 Aug 26 00:10:06 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Acquiring lock "cinder-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "cinder-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Acquiring lock "cinder-quobyte-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "cinder-quobyte-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430f70e-5ee4-4727-8aed-36bb3b780271]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:07 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a Aug 26 00:10:07 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:07 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" returned: 0 in 0.635s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:07 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753 Aug 26 00:10:07 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:07 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97.bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-bbd5c2f6-5ea3-4b46-b4af-886f3ec0c753" released by "_delete_snapshot" :: held 2.772s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" released by "delete_snapshot" :: held 2.823s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:07 devstack cinder-volume[94433]: WARNING cinder.quota [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1064393431 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1064393431, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:10:07 devstack cinder-volume[94433]: WARNING cinder.quota [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1064393431 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1064393431, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] Created reservations ['b1339689-c372-4238-9170-db673e53ee78', 'c03b3d51-8dde-4204-9b95-6fdf9da24116', 'e41d0f71-4ea4-46b7-99bf-07beab9bced6', '97034a92-dd59-48f9-ae9f-f7ddbb9ce0d3'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:07 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" returned: 0 in 0.745s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:07 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a Aug 26 00:10:07 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-600ff9ef-e001-4e3a-abb1-52dbc620128b tempest-GroupSnapshotsTest-243374487 None] group_snapshot aba85cab-32da-4c5a-a10a-8d08e86244a9: deleted successfully Aug 26 00:10:08 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "cinder-quobyte-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a" released by "delete_volume" :: held 1.220s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Created reservations ['f5e93ee2-79ac-4933-8abf-028adce82266', 'b8f27273-4333-466f-a2f9-5784691930c0', '207b2130-baa5-484d-86d8-9ae65fc832d2', '040f1652-209d-44af-ae1e-339244848d1f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:08 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:08 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:09 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.560s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Deleted volume successfully. Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddd36bd8-7d61-4b1c-805d-b5885fdc392c tempest-AttachVolumeShelveTestJSON-813902958 None] Lock "cinder-34e83d98-7c0c-4f9b-9ce9-dbcd3212967a-delete_volume" released by "delete_volume" :: held 2.336s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" acquired by "delete_volume" :: waited 0.055s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0343469-5016-40ab-91c4-8d11ae855ecd]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:09 devstack sudo[101788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 Aug 26 00:10:09 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:10 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97" returned: 0 in 0.809s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:10 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97 Aug 26 00:10:10 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:10 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b9fa4433-0edc-482a-962b-efaad3138e97" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Lock "cinder-quobyte-b9fa4433-0edc-482a-962b-efaad3138e97" released by "delete_volume" :: held 1.421s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['404a47f3-1745-41e6-a7c6-78f91c723017'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:10 devstack cinder-volume[94433]: WARNING cinder.quota [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1064393431 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1064393431, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:10:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Created reservations ['872c26ab-d35d-4fcd-9c14-0580a4ffeec0', 'acea6c80-7db6-454c-a3a2-687d624a5e8a', 'a467ad3c-c816-489d-94c8-d9acc35d56ef', 'dc248a29-1767-4cd8-89a0-7e79534c4b90'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:11 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:11 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:11 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.529s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:11 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d1bb6e8-e904-4da3-af35-a0f83ba5e230 tempest-GroupSnapshotsTest-243374487 None] Delete group completed successfully. Aug 26 00:10:21 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=89,cinder:UPDATE=95,cinder:INSERT=20,cinder:DELETE=4 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:10:21 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=96,cinder:DELETE=3 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Flow 'volume_create_manager' (58efae0b-bf9b-41a3-8fb7-66bf2e52b630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a94753-de62-4a1e-b31a-656ff8211f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a94753-de62-4a1e-b31a-656ff8211f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-643926642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45441744-ecd5-4f8b-86b4-b4aa4f0fec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80c3196f6d547b486558188d2ec3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:33Z,use_quota=True,user_id='65937bcf0d1944f182efc260e2f1b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdd5090-7cba-4df9-a4e2-3bb42d10beb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdd5090-7cba-4df9-a4e2-3bb42d10beb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69ccb0b-1998-4630-8bd2-201119684e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69ccb0b-1998-4630-8bd2-201119684e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45441744-ecd5-4f8b-86b4-b4aa4f0fec55', 'volume_name': 'volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bad2a15-2987-42cd-a8e2-664d91456c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bad2a15-2987-42cd-a8e2-664d91456c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31b2ad-cd8a-435d-aff9-c3cefe5d9ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume 45441744-ecd5-4f8b-86b4-b4aa4f0fec55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55', 'volume_size': 1} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-643926642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45441744-ecd5-4f8b-86b4-b4aa4f0fec55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80c3196f6d547b486558188d2ec3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:33Z,use_quota=True,user_id='65937bcf0d1944f182efc260e2f1b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Creating volume 45441744-ecd5-4f8b-86b4-b4aa4f0fec55 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:10:32 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:10:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:32 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 1073741824 Aug 26 00:10:32 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:33 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 1073741824" returned: 0 in 0.652s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Flow 'volume_create_manager' (f28c8fa9-5c04-4c6d-beac-1d4dc6fa4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c6858c-a2d2-401c-942f-2309797e328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c6858c-a2d2-401c-942f-2309797e328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-222358900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91effd36-ef94-4e69-8a2e-d7b9ad5b05f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80c3196f6d547b486558188d2ec3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:33Z,use_quota=True,user_id='65937bcf0d1944f182efc260e2f1b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360bd74-f7ff-4596-81fc-406fde4cbc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d360bd74-f7ff-4596-81fc-406fde4cbc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf8a6fd-4387-4e85-8bae-fe78dcba450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cf8a6fd-4387-4e85-8bae-fe78dcba450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91effd36-ef94-4e69-8a2e-d7b9ad5b05f8', 'volume_name': 'volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb172ef-a648-445d-8c0b-8e7eabe26e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb172ef-a648-445d-8c0b-8e7eabe26e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9b4a78-876f-42b2-8f56-80e664748adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume 91effd36-ef94-4e69-8a2e-d7b9ad5b05f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8', 'volume_size': 1} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:33 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 Aug 26 00:10:33 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:34 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" returned: 0 in 0.419s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.431s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-222358900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91effd36-ef94-4e69-8a2e-d7b9ad5b05f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80c3196f6d547b486558188d2ec3c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:33Z,use_quota=True,user_id='65937bcf0d1944f182efc260e2f1b88f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Creating volume 91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:10:34 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31b2ad-cd8a-435d-aff9-c3cefe5d9ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:34 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 1073741824 Aug 26 00:10:34 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7a94f3-f6d4-457b-b791-61b9d98c31d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 (45441744-ecd5-4f8b-86b4-b4aa4f0fec55): created successfully Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d7a94f3-f6d4-457b-b791-61b9d98c31d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Flow 'volume_create_manager' (58efae0b-bf9b-41a3-8fb7-66bf2e52b630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-75a0bb4a-901f-4222-82a0-c1ad0405a323 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Created volume successfully. Aug 26 00:10:34 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 1073741824" returned: 0 in 0.695s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:34 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 Aug 26 00:10:34 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:35 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" returned: 0 in 0.373s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e9b4a78-876f-42b2-8f56-80e664748adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615822b4-f8bb-40dc-bb5b-29dc7ea36fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Volume volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 (91effd36-ef94-4e69-8a2e-d7b9ad5b05f8): created successfully Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615822b4-f8bb-40dc-bb5b-29dc7ea36fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Flow 'volume_create_manager' (f28c8fa9-5c04-4c6d-beac-1d4dc6fa4588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-78483400-834d-4ac1-8d9a-e18a5c10d4ec tempest-TestServerVolumeAttachmentScenario-1758870752 None] Created volume successfully. Aug 26 00:10:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-1d87ceb7-3bd4-48d3-a851-db964d4e2e4a tempest-ServerActionsTestOtherA-1604735046 None] Terminate volume connection completed successfully. Aug 26 00:10:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-1d87ceb7-3bd4-48d3-a851-db964d4e2e4a tempest-ServerActionsTestOtherA-1604735046 None] Deleting attachment 0dd3cc99-c2b4-4070-b05f-824bf01c6b81. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "cinder-a84678bf-c010-4c05-8d15-a8f312f0c35c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-a84678bf-c010-4c05-8d15-a8f312f0c35c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "cinder-quobyte-a84678bf-c010-4c05-8d15-a8f312f0c35c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-quobyte-a84678bf-c010-4c05-8d15-a8f312f0c35c" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09acd56-0b96-4be9-aa2f-52594151693f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:39 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c Aug 26 00:10:39 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:39 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:39 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c Aug 26 00:10:39 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "cinder-0a6382bc-59d0-4890-9366-898c7b47f75c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:40 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-0a6382bc-59d0-4890-9366-898c7b47f75c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a84678bf-c010-4c05-8d15-a8f312f0c35c" returned: 0 in 0.419s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-quobyte-a84678bf-c010-4c05-8d15-a8f312f0c35c" released by "delete_volume" :: held 0.983s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "cinder-quobyte-0a6382bc-59d0-4890-9366-898c7b47f75c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-quobyte-0a6382bc-59d0-4890-9366-898c7b47f75c" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[33391401-7c8d-4b78-a377-004eb89b4c41]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.quota [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Created reservations ['47157434-7a9e-4b25-b5ca-da20d10e5e99', 'a8eccd5c-2b93-47bb-bd0e-8b110369c168', '76757a18-e521-4db8-8b30-2b78a3ad5b16', '8501f4ec-e9b9-4614-b302-33adc6654164'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:40 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c Aug 26 00:10:40 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:40 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:40 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:40 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.323s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.manager [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Deleted volume successfully. Aug 26 00:10:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-dbe7bd64-2c36-4ab0-8fbd-b30e5098d3c5 req-88a394c7-89ee-4937-932d-1e29e7ee2bd3 tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-a84678bf-c010-4c05-8d15-a8f312f0c35c-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:41 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c" returned: 0 in 0.666s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:41 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c Aug 26 00:10:41 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:41 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0a6382bc-59d0-4890-9366-898c7b47f75c" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-quobyte-0a6382bc-59d0-4890-9366-898c7b47f75c" released by "delete_volume" :: held 1.147s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Created reservations ['67b7cce4-c32a-4191-b0a1-730d71107786', '45849c3e-37fa-4ad9-b097-2fadc824ade8', '57643b7e-f1d4-4adb-8e4d-aeb63f4792f5', '8b869241-f62f-4ffa-a9e4-95ace68d6b2e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:41 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:41 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:42 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.432s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:42 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:42 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Deleted volume successfully. Aug 26 00:10:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4646fe1b-2395-4f11-8bcb-48d5f72eac6c tempest-ServerActionsTestOtherA-1604735046 None] Lock "cinder-0a6382bc-59d0-4890-9366-898c7b47f75c-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:46 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:46 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:46 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:10:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:10:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7cc5c74d-7d72-4f29-a683-ae8923c3c025 tempest-GroupsTest-1371146358 None] Group tempest-Group1-1914713039: creating Aug 26 00:10:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7cc5c74d-7d72-4f29-a683-ae8923c3c025 tempest-GroupsTest-1371146358 None] Group tempest-Group1-1914713039: created successfully Aug 26 00:10:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7cc5c74d-7d72-4f29-a683-ae8923c3c025 tempest-GroupsTest-1371146358 None] Create group completed successfully. Aug 26 00:10:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1deb4312-03c1-4354-8f47-83972fadb16a tempest-GroupsTest-1371146358 None] Group tempest-Group2-1595055472: creating Aug 26 00:10:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1deb4312-03c1-4354-8f47-83972fadb16a tempest-GroupsTest-1371146358 None] Group tempest-Group2-1595055472: created successfully Aug 26 00:10:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1deb4312-03c1-4354-8f47-83972fadb16a tempest-GroupsTest-1371146358 None] Create group completed successfully. Aug 26 00:10:50 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (99799dfc-8e07-4490-b866-0349701da657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053ff0a3-611d-483e-9e52-368efdb7e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053ff0a3-611d-483e-9e52-368efdb7e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1387208597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c501fb95-3c36-47e8-919c-a2a581b2e098,host='devstack@QuobyteHD#QuobyteHD',id=438f9d1b-0b83-4349-a900-6abdb593244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:51Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1df69c1-bb57-4589-aebe-754bf0792a87),volume_type_id=a1df69c1-bb57-4589-aebe-754bf0792a87)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bd9e3d-6c6e-496d-943e-054c38741c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80bd9e3d-6c6e-496d-943e-054c38741c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5159e64b-502f-4382-8aba-688975fc7b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5159e64b-502f-4382-8aba-688975fc7b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '438f9d1b-0b83-4349-a900-6abdb593244f', 'volume_name': 'volume-438f9d1b-0b83-4349-a900-6abdb593244f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59bbe8a-f62d-4a13-b33d-c591257cf8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59bbe8a-f62d-4a13-b33d-c591257cf8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b2aeca-a29a-4941-983d-1e7da9f3c254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:51 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Volume 438f9d1b-0b83-4349-a900-6abdb593244f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-438f9d1b-0b83-4349-a900-6abdb593244f', 'volume_size': 1} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c501fb95-3c36-47e8-919c-a2a581b2e098,created_at=2026-08-25T22:10:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1387208597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c501fb95-3c36-47e8-919c-a2a581b2e098,host='devstack@QuobyteHD#QuobyteHD',id=438f9d1b-0b83-4349-a900-6abdb593244f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:10:51Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1df69c1-bb57-4589-aebe-754bf0792a87),volume_type_id=a1df69c1-bb57-4589-aebe-754bf0792a87)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Creating volume 438f9d1b-0b83-4349-a900-6abdb593244f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:10:51 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:51 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f 1073741824 Aug 26 00:10:51 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:51 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f 1073741824" returned: 0 in 0.735s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:52 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f Aug 26 00:10:52 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:52 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f" returned: 0 in 0.405s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94b2aeca-a29a-4941-983d-1e7da9f3c254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-438f9d1b-0b83-4349-a900-6abdb593244f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8baee9f-de44-4633-b62d-9373cc5296df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:10:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Volume volume-438f9d1b-0b83-4349-a900-6abdb593244f (438f9d1b-0b83-4349-a900-6abdb593244f): created successfully Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8baee9f-de44-4633-b62d-9373cc5296df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:10:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (99799dfc-8e07-4490-b866-0349701da657) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:10:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-dd5b97f8-3bf9-4e7a-8052-b6da09b682fc tempest-GroupsTest-1371146358 None] Created volume successfully. Aug 26 00:10:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Acquiring lock "cinder-quobyte-438f9d1b-0b83-4349-a900-6abdb593244f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:10:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-438f9d1b-0b83-4349-a900-6abdb593244f" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:10:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1197f128-3bf5-4ac2-adb1-31e0a0c02cfc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:10:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:55 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f Aug 26 00:10:55 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:56 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f" returned: 0 in 0.891s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:56 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f Aug 26 00:10:56 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:56 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-438f9d1b-0b83-4349-a900-6abdb593244f" returned: 0 in 0.458s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-438f9d1b-0b83-4349-a900-6abdb593244f" released by "delete_volume" :: held 1.419s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Created reservations ['7040d92a-fe8c-4764-ab5a-417487ac144f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:56 devstack cinder-volume[94433]: WARNING cinder.quota [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-309671987 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-309671987, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:10:56 devstack cinder-volume[94433]: WARNING cinder.quota [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-309671987 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-309671987, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Created reservations ['8baaced4-bddc-47c6-8640-a8fe73e2b750', '21ff3bc9-4d65-4afe-a62c-009a3bc65ddf', '21658e83-24f3-4100-b231-4dfdc0ae5334', '043559fc-a1a0-4b1e-8f1f-5cbf7c8c9200'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:57 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:57 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:57 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.387s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:57 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d43330fb-5325-4919-8118-9c4941632425 tempest-GroupsTest-1371146358 None] Delete group completed successfully. Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Created reservations ['6eae858d-c089-4128-9a70-49ea67950578'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:10:58 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:10:58 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:10:58 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.458s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:10:58 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:10:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-acb23259-5d35-408d-9e08-91e3343f9d4e tempest-GroupsTest-1371146358 None] Delete group completed successfully. Aug 26 00:11:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-354f23b4-fa4b-4169-930f-59fb739c3a4f tempest-GroupsTest-1371146358 None] Group tempest-GroupsTest-Group-1629664013: creating Aug 26 00:11:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-354f23b4-fa4b-4169-930f-59fb739c3a4f tempest-GroupsTest-1371146358 None] Group tempest-GroupsTest-Group-1629664013: created successfully Aug 26 00:11:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-354f23b4-fa4b-4169-930f-59fb739c3a4f tempest-GroupsTest-1371146358 None] Create group completed successfully. Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (b9577fc4-0791-4230-9a75-795ff34160ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feeac8c4-197e-402c-ad5f-48b9be954cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feeac8c4-197e-402c-ad5f-48b9be954cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720463493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,host='devstack@QuobyteHD#QuobyteHD',id=06ee348f-5136-4317-b560-8ee99205e682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:03Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cee6c05-7261-4ecb-8090-6928282cfc05),volume_type_id=6cee6c05-7261-4ecb-8090-6928282cfc05)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a5f5f-af71-466a-9409-eb65eb19e7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a5f5f-af71-466a-9409-eb65eb19e7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55979d3-e6e7-444c-a7bb-179742354e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55979d3-e6e7-444c-a7bb-179742354e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ee348f-5136-4317-b560-8ee99205e682', 'volume_name': 'volume-06ee348f-5136-4317-b560-8ee99205e682', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4ba99-ff75-44a0-b5ab-a3e005d5fa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff4ba99-ff75-44a0-b5ab-a3e005d5fa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe55517-d315-44eb-8b8a-62735f633fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Volume 06ee348f-5136-4317-b560-8ee99205e682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ee348f-5136-4317-b560-8ee99205e682', 'volume_size': 1} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,created_at=2026-08-25T22:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-720463493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,host='devstack@QuobyteHD#QuobyteHD',id=06ee348f-5136-4317-b560-8ee99205e682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:03Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cee6c05-7261-4ecb-8090-6928282cfc05),volume_type_id=6cee6c05-7261-4ecb-8090-6928282cfc05)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Creating volume 06ee348f-5136-4317-b560-8ee99205e682 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:02 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:02 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 1073741824 Aug 26 00:11:02 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:03 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 1073741824" returned: 0 in 0.609s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:03 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 Aug 26 00:11:03 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:03 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682" returned: 0 in 0.411s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe55517-d315-44eb-8b8a-62735f633fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ee348f-5136-4317-b560-8ee99205e682', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77242e20-db56-432a-baef-c3790465d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:03 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Volume volume-06ee348f-5136-4317-b560-8ee99205e682 (06ee348f-5136-4317-b560-8ee99205e682): created successfully Aug 26 00:11:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77242e20-db56-432a-baef-c3790465d60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (b9577fc4-0791-4230-9a75-795ff34160ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-78b4df47-025c-4ab7-854a-c4f04a7b5566 tempest-GroupsTest-1371146358 None] Created volume successfully. Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (5bdd1119-18b9-4689-a7d4-6c7bef569931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa138732-e84e-49c6-85ec-45728f9d7197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa138732-e84e-49c6-85ec-45728f9d7197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,host='devstack@QuobyteHD#QuobyteHD',id=00b06054-0575-42f9-bd7b-5226f2ea342e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:06Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cee6c05-7261-4ecb-8090-6928282cfc05),volume_type_id=6cee6c05-7261-4ecb-8090-6928282cfc05)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972736a9-8542-4906-b308-3f68ce6d4915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972736a9-8542-4906-b308-3f68ce6d4915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f71c29-3552-40f0-bede-e583198c9dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f71c29-3552-40f0-bede-e583198c9dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b06054-0575-42f9-bd7b-5226f2ea342e', 'volume_name': 'volume-00b06054-0575-42f9-bd7b-5226f2ea342e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a35a8-6f57-46f7-9460-adb392412985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f9a35a8-6f57-46f7-9460-adb392412985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e658429-0163-4570-8794-fe597ab6dcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Volume 00b06054-0575-42f9-bd7b-5226f2ea342e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b06054-0575-42f9-bd7b-5226f2ea342e', 'volume_size': 1} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,created_at=2026-08-25T22:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1466861408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd63546f-d169-45c3-8ff7-1f8a2c0cb46c,host='devstack@QuobyteHD#QuobyteHD',id=00b06054-0575-42f9-bd7b-5226f2ea342e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01f9f4c91bc34b4a8d4f8ae611bfc0fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:06Z,use_quota=True,user_id='b635a4fc1e2d44418a5ee088d66608c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cee6c05-7261-4ecb-8090-6928282cfc05),volume_type_id=6cee6c05-7261-4ecb-8090-6928282cfc05)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Creating volume 00b06054-0575-42f9-bd7b-5226f2ea342e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:06 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:06 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e 1073741824 Aug 26 00:11:06 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:07 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e 1073741824" returned: 0 in 0.553s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:07 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e Aug 26 00:11:07 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:07 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e658429-0163-4570-8794-fe597ab6dcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b06054-0575-42f9-bd7b-5226f2ea342e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35e550d-b212-43f6-b0d6-80297fa4b1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Volume volume-00b06054-0575-42f9-bd7b-5226f2ea342e (00b06054-0575-42f9-bd7b-5226f2ea342e): created successfully Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35e550d-b212-43f6-b0d6-80297fa4b1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Flow 'volume_create_manager' (5bdd1119-18b9-4689-a7d4-6c7bef569931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a8aa66ea-d62a-4242-8bae-b6f4e3b00245 tempest-GroupsTest-1371146358 None] Created volume successfully. Aug 26 00:11:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ae76cfcb-3a3a-450a-94ba-2c2350fe308b tempest-GroupsTest-1371146358 None] Update group completed successfully. Aug 26 00:11:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d1e5b4d-bc53-4d1e-88d1-3ebba1d0fe9c tempest-GroupsTest-1371146358 None] Update group completed successfully. Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Acquiring lock "cinder-quobyte-00b06054-0575-42f9-bd7b-5226f2ea342e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-00b06054-0575-42f9-bd7b-5226f2ea342e" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6c51dd-039c-4326-83a6-7b7c3b65653a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:12 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e Aug 26 00:11:12 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:12 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:12 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e Aug 26 00:11:12 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:12 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-00b06054-0575-42f9-bd7b-5226f2ea342e" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-00b06054-0575-42f9-bd7b-5226f2ea342e" released by "delete_volume" :: held 0.716s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Acquiring lock "cinder-quobyte-06ee348f-5136-4317-b560-8ee99205e682" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-06ee348f-5136-4317-b560-8ee99205e682" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcb93bd-edbd-4f0c-99f5-bbb172f06160]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:13 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 Aug 26 00:11:13 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:13 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682" returned: 0 in 0.410s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:13 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682 Aug 26 00:11:13 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:13 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06ee348f-5136-4317-b560-8ee99205e682" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "cinder-quobyte-06ee348f-5136-4317-b560-8ee99205e682" released by "delete_volume" :: held 0.737s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Created reservations ['dcf424e3-e48e-4cd3-be7b-c61a0d11181f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:13 devstack cinder-volume[94433]: WARNING cinder.quota [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-805801950 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-805801950, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:11:13 devstack cinder-volume[94433]: WARNING cinder.quota [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-805801950 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-805801950, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Created reservations ['5b45f6e0-979f-4d3d-9e07-2df4952f3e83', '6daa32b7-089b-4217-b73a-53f062cd584d', '16281c24-52b2-4065-9667-40ad82299fe8', '2217976d-489d-4aa5-b2dd-4183ab5aa430'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Created reservations ['648bde78-293a-46eb-b47d-5cc61c7d2112', '59cac394-2e92-4f1a-ac65-7f0274f5a72c', '22d5f0dd-e40a-4999-bdf9-0e92061d27e3', '300093ca-57a9-41bb-bf7a-9b260561ec52'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:14 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:14 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:14 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8b674914-abd3-4ff3-b039-56bd03d4ea6d tempest-GroupsTest-1371146358 None] Delete group completed successfully. Aug 26 00:11:17 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (8b68a469-e603-4cc6-a00b-05fd59561b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb06604-7b2c-4386-9bb6-42a1899836e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb06604-7b2c-4386-9bb6-42a1899836e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-529271853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864bc48-6f4e-44c7-b088-b6d79e7a0845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:18Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f88331-c6c1-4748-b65d-4515773bdd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f88331-c6c1-4748-b65d-4515773bdd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca17990-0ef0-4487-9ec4-8644d499a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eca17990-0ef0-4487-9ec4-8644d499a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8864bc48-6f4e-44c7-b088-b6d79e7a0845', 'volume_name': 'volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878734df-0128-407d-958e-2e30b4b5afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878734df-0128-407d-958e-2e30b4b5afee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe8de62-7d95-44c0-af5a-54832cecabf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Volume 8864bc48-6f4e-44c7-b088-b6d79e7a0845: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845', 'volume_size': 1} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-529271853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8864bc48-6f4e-44c7-b088-b6d79e7a0845,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:18Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Creating volume 8864bc48-6f4e-44c7-b088-b6d79e7a0845 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:18 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:18 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 1073741824 Aug 26 00:11:18 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:18 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 1073741824" returned: 0 in 0.654s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:18 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 Aug 26 00:11:18 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:19 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe8de62-7d95-44c0-af5a-54832cecabf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166441b-bd3b-4636-87b2-81639a7c3cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Volume volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 (8864bc48-6f4e-44c7-b088-b6d79e7a0845): created successfully Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a166441b-bd3b-4636-87b2-81639a7c3cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (8b68a469-e603-4cc6-a00b-05fd59561b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d72d57a8-6c85-4475-afdb-85cff675d55e tempest-AttachVolumeNegativeTest-1984808805 None] Created volume successfully. Aug 26 00:11:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-830f39dc-0e51-4694-af3d-f4aba7a26fd5 req-68fa210b-8fa7-4f39-b9e2-4cba25eaf504 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-830f39dc-0e51-4694-af3d-f4aba7a26fd5 req-68fa210b-8fa7-4f39-b9e2-4cba25eaf504 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-830f39dc-0e51-4694-af3d-f4aba7a26fd5 req-68fa210b-8fa7-4f39-b9e2-4cba25eaf504 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-830f39dc-0e51-4694-af3d-f4aba7a26fd5 req-68fa210b-8fa7-4f39-b9e2-4cba25eaf504 tempest-AttachVolumeNegativeTest-1984808805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'db45d6b6-dbc6-4b02-a9f1-07ff793d3ada', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:11:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-830f39dc-0e51-4694-af3d-f4aba7a26fd5 req-68fa210b-8fa7-4f39-b9e2-4cba25eaf504 tempest-AttachVolumeNegativeTest-1984808805 None] attachment_update completed successfully. Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Flow 'volume_create_manager' (82098411-e814-4ba2-a1b0-bec09e23af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412a886e-b6cf-493a-bca4-222921989af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (412a886e-b6cf-493a-bca4-222921989af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1895992408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582d096-20d5-40e9-bcfa-4686e389c18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e739d13acdf43de9958e74274cd7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:22Z,use_quota=True,user_id='2c9479690b4e4ba496214b38eb2ec7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44934fd4-2f26-4b13-a3c6-41d5b58b45e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44934fd4-2f26-4b13-a3c6-41d5b58b45e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebbc1f4-a088-49ed-9632-f874f3205b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebbc1f4-a088-49ed-9632-f874f3205b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0582d096-20d5-40e9-bcfa-4686e389c18f', 'volume_name': 'volume-0582d096-20d5-40e9-bcfa-4686e389c18f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996cc699-048e-4a68-94e8-534e721d4238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996cc699-048e-4a68-94e8-534e721d4238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ba330-6b98-4c19-b182-69d089c9a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:22 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Volume 0582d096-20d5-40e9-bcfa-4686e389c18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0582d096-20d5-40e9-bcfa-4686e389c18f', 'volume_size': 1} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1895992408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0582d096-20d5-40e9-bcfa-4686e389c18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e739d13acdf43de9958e74274cd7d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:22Z,use_quota=True,user_id='2c9479690b4e4ba496214b38eb2ec7e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Creating volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:22 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:22 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f 1073741824 Aug 26 00:11:22 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:23 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f 1073741824" returned: 0 in 0.749s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9d890f70-f39d-4832-939a-31cc784ebe01 req-da732511-5cab-4c5f-a677-73085f89664c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:23 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f Aug 26 00:11:23 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:23 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f" returned: 0 in 0.291s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9d890f70-f39d-4832-939a-31cc784ebe01 req-da732511-5cab-4c5f-a677-73085f89664c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.308s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee3ba330-6b98-4c19-b182-69d089c9a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0582d096-20d5-40e9-bcfa-4686e389c18f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489a6bb4-e033-4e9f-b2c8-05ca8feeea04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9d890f70-f39d-4832-939a-31cc784ebe01 req-da732511-5cab-4c5f-a677-73085f89664c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.064s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:23 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Volume volume-0582d096-20d5-40e9-bcfa-4686e389c18f (0582d096-20d5-40e9-bcfa-4686e389c18f): created successfully Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (489a6bb4-e033-4e9f-b2c8-05ca8feeea04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Flow 'volume_create_manager' (82098411-e814-4ba2-a1b0-bec09e23af06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ea0fb4c1-57d0-4d2b-be80-b6f6cac2eb3c tempest-SnapshotsActionsTest-1587492695 None] Created volume successfully. Aug 26 00:11:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-9d890f70-f39d-4832-939a-31cc784ebe01 req-da732511-5cab-4c5f-a677-73085f89664c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '59e3295f-cec2-49e5-8061-0d9ea3cdfb29', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:11:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9d890f70-f39d-4832-939a-31cc784ebe01 req-da732511-5cab-4c5f-a677-73085f89664c tempest-TestServerVolumeAttachmentScenario-1758870752 None] attachment_update completed successfully. Aug 26 00:11:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Creating offline snapshot 8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:11:24 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81fe25f-f66d-4b69-ab3e-95a3b1ec4ffe]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:25 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f Aug 26 00:11:25 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:25 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f" returned: 0 in 0.640s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:25 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb 1G Aug 26 00:11:25 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:26 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb 1G" returned: 0 in 0.820s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:26 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:26 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:26 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.450s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:26 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb is being set with open permissions: ugo+rw Aug 26 00:11:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:26 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:26 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:27 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.358s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:27 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info Aug 26 00:11:27 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:27 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info" returned: 0 in 0.482s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:27 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info is being set with open permissions: ugo+rw Aug 26 00:11:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:27 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info Aug 26 00:11:27 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:28 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.info" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.309s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3336ec48-6e3b-4f47-9ded-47284dc833ea tempest-SnapshotsActionsTest-1587492695 None] Create snapshot completed successfully Aug 26 00:11:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Creating offline snapshot 175aecd0-0670-42e2-90b2-dfddff244dfa of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:11:30 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8df74a-146d-4a23-a6a3-6d4d7c39a01f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:30 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:30 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:31 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.718s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:31 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa 1G Aug 26 00:11:31 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=73,cinder:UPDATE=83,cinder:DELETE=4,cinder:INSERT=12 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=85,cinder:UPDATE=75,cinder:INSERT=19,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:11:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-a2065b07-c558-4f4f-aeea-b2849e243efb req-b7a3f3e0-02d1-47d5-b333-723e2acbd0f5 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:32 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa 1G" returned: 0 in 1.022s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:32 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa Aug 26 00:11:32 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:32 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa" returned: 0 in 0.584s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:32 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa is being set with open permissions: ugo+rw Aug 26 00:11:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:32 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa Aug 26 00:11:32 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:33 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.877s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-a2065b07-c558-4f4f-aeea-b2849e243efb req-b7a3f3e0-02d1-47d5-b333-723e2acbd0f5 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.199s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-a2065b07-c558-4f4f-aeea-b2849e243efb req-b7a3f3e0-02d1-47d5-b333-723e2acbd0f5 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f77e3b19-b351-4db2-862e-595466f25742 tempest-SnapshotsActionsTest-1587492695 None] Create snapshot completed successfully Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-a2065b07-c558-4f4f-aeea-b2849e243efb req-b7a3f3e0-02d1-47d5-b333-723e2acbd0f5 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0a058f2-50b1-47aa-b133-e9edef38caeb', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:11:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-a2065b07-c558-4f4f-aeea-b2849e243efb req-b7a3f3e0-02d1-47d5-b333-723e2acbd0f5 tempest-TestServerVolumeAttachmentScenario-1758870752 None] attachment_update completed successfully. Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-175aecd0-0670-42e2-90b2-dfddff244dfa-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-175aecd0-0670-42e2-90b2-dfddff244dfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-175aecd0-0670-42e2-90b2-dfddff244dfa" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-175aecd0-0670-42e2-90b2-dfddff244dfa" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Deleting offline snapshot 175aecd0-0670-42e2-90b2-dfddff244dfa of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] snapshot_file for this snap is: volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584fc50-e37e-4afc-8ca0-abb94e528855]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:34 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa Aug 26 00:11:34 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:34 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa" returned: 0 in 0.974s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11237ef-3fa7-4342-bb8b-756aff852c07]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:35 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:35 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:35 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.798s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:35 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa Aug 26 00:11:35 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:37 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa" returned: 0 in 1.136s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:37 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa Aug 26 00:11:37 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:37 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.175aecd0-0670-42e2-90b2-dfddff244dfa" returned: 0 in 0.463s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-175aecd0-0670-42e2-90b2-dfddff244dfa" released by "_delete_snapshot" :: held 3.587s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_snapshot" :: held 3.620s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-2a286bf6-4f22-4cd2-9dae-6662f9392196 req-485befc4-15c6-4fe2-a3d1-3646e7fe5d8b tempest-TestServerVolumeAttachmentScenario-1758870752 None] Terminate volume connection completed successfully. Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-2a286bf6-4f22-4cd2-9dae-6662f9392196 req-485befc4-15c6-4fe2-a3d1-3646e7fe5d8b tempest-TestServerVolumeAttachmentScenario-1758870752 None] Deleting attachment b0a058f2-50b1-47aa-b133-e9edef38caeb. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Created reservations ['3643810d-1131-4233-a3a0-bcc50c137698', 'ac4d4741-542b-4e45-8445-6ecfbcc3c7df', '29ea6c8d-8b23-41fe-9b42-be1ef2e151d4', 'acce98f9-b8bc-4080-b6af-28c9f9cfcbf3'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Delete snapshot completed successfully. Aug 26 00:11:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f79a106c-d17e-447c-8c85-d5892c6c9155 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-175aecd0-0670-42e2-90b2-dfddff244dfa-delete_snapshot" released by "delete_snapshot" :: held 3.836s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Creating offline snapshot d0998f79-70d5-4ac8-b993-7c10d7dc52d0 of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:11:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabdea0-8757-4e10-a6f9-e0b3c50911b2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:39 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:39 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:40 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.708s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:40 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 1G Aug 26 00:11:40 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:40 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 1G" returned: 0 in 0.792s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:40 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 Aug 26 00:11:40 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-24bf5787-0f1d-4cea-9e20-631ed90dfb34 req-03e7d07d-812b-4c1f-9d83-5dda4b99c328 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Terminate volume connection completed successfully. Aug 26 00:11:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-24bf5787-0f1d-4cea-9e20-631ed90dfb34 req-03e7d07d-812b-4c1f-9d83-5dda4b99c328 tempest-TestServerVolumeAttachmentScenario-1758870752 None] Deleting attachment 59e3295f-cec2-49e5-8061-0d9ea3cdfb29. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:11:41 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:41 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 is being set with open permissions: ugo+rw Aug 26 00:11:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:41 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 Aug 26 00:11:41 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:41 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0" returned: 0 in 0.397s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.692s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a65e43af-e036-458b-80f4-11220636656a tempest-SnapshotsActionsTest-1587492695 None] Create snapshot completed successfully Aug 26 00:11:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-d0998f79-70d5-4ac8-b993-7c10d7dc52d0-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-d0998f79-70d5-4ac8-b993-7c10d7dc52d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_snapshot" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-d0998f79-70d5-4ac8-b993-7c10d7dc52d0" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-d0998f79-70d5-4ac8-b993-7c10d7dc52d0" acquired by "_delete_snapshot" :: waited 0.203s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Deleting offline snapshot d0998f79-70d5-4ac8-b993-7c10d7dc52d0 of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:11:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] snapshot_file for this snap is: volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:11:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbf593c-40c9-4bb5-9049-ae895b4be2a4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:43 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 Aug 26 00:11:43 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:44 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0" returned: 0 in 1.117s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff2f365-d1de-4f9b-9b34-554cb22ab262]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:44 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:44 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:45 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 1.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:45 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 Aug 26 00:11:45 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:46 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0" returned: 0 in 0.896s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:46 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0 Aug 26 00:11:46 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:46 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:46 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.d0998f79-70d5-4ac8-b993-7c10d7dc52d0" returned: 0 in 0.625s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:47 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:47 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.710s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-d0998f79-70d5-4ac8-b993-7c10d7dc52d0" released by "_delete_snapshot" :: held 4.232s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_snapshot" :: held 4.478s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Created reservations ['860202be-5501-4567-841f-49228cb9a8c2', '55fee439-7a9d-4ec7-aea1-e3f9686d3bfc', '2bf461e4-670b-4e0b-bd26-70863621c37e', '9616ac24-8d39-4fe5-a981-37bb7bb4d5a2'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Delete snapshot completed successfully. Aug 26 00:11:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d57648b-e787-444c-87f3-b80106ec3b67 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-d0998f79-70d5-4ac8-b993-7c10d7dc52d0-delete_snapshot" released by "delete_snapshot" :: held 4.778s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Creating offline snapshot 1b310586-513b-4a9e-b9d2-5668b8a09fb2 of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[33550f9b-136a-4a93-8663-6a1408d80b50]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:49 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:49 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:49 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.444s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:49 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 1G Aug 26 00:11:49 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:50 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 1G" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:50 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 Aug 26 00:11:50 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:50 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:50 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 is being set with open permissions: ugo+rw Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:50 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 Aug 26 00:11:50 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Flow 'volume_create_manager' (fc24a018-e764-4ad3-8770-1e0e747c9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf88638-d957-4daa-b66f-0f96f0a89cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf88638-d957-4daa-b66f-0f96f0a89cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1668454060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3518dc8a-0ef9-469a-8c9a-436b69898de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7e30d8d2244bfcae7e225dc9654f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:51Z,use_quota=True,user_id='b4f8c1f6024640359a9c1ae12e2f0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a627efef-2fd8-4515-9868-f0326471972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a627efef-2fd8-4515-9868-f0326471972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3524ef2-0421-4cd7-a9be-747ed0d48c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3524ef2-0421-4cd7-a9be-747ed0d48c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3518dc8a-0ef9-469a-8c9a-436b69898de4', 'volume_name': 'volume-3518dc8a-0ef9-469a-8c9a-436b69898de4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45c6724-5108-4233-9165-bd32b6440cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f45c6724-5108-4233-9165-bd32b6440cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce745021-6390-44b5-9e8a-288040c3e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:50 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Volume 3518dc8a-0ef9-469a-8c9a-436b69898de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3518dc8a-0ef9-469a-8c9a-436b69898de4', 'volume_size': 1} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:50 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1668454060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3518dc8a-0ef9-469a-8c9a-436b69898de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7e30d8d2244bfcae7e225dc9654f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:51Z,use_quota=True,user_id='b4f8c1f6024640359a9c1ae12e2f0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Creating volume 3518dc8a-0ef9-469a-8c9a-436b69898de4 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:50 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:50 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 1073741824 Aug 26 00:11:50 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:50 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ca892fe1-7594-45e5-b7f1-0b87ac0c7aef tempest-SnapshotsActionsTest-1587492695 None] Create snapshot completed successfully Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-1b310586-513b-4a9e-b9d2-5668b8a09fb2-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "cinder-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-1b310586-513b-4a9e-b9d2-5668b8a09fb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-1b310586-513b-4a9e-b9d2-5668b8a09fb2" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-1b310586-513b-4a9e-b9d2-5668b8a09fb2" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Deleting offline snapshot 1b310586-513b-4a9e-b9d2-5668b8a09fb2 of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] snapshot_file for this snap is: volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d051e3-3bc1-4f73-8912-e7dc98382468]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "cinder-quobyte-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:51 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 1073741824" returned: 0 in 0.624s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-quobyte-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" acquired by "delete_volume" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0f9093-7752-4dca-bce0-2efa63996108]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:51 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 Aug 26 00:11:51 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:51 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 Aug 26 00:11:51 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:51 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 Aug 26 00:11:51 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:51 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2" returned: 0 in 0.445s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:51 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4" returned: 0 in 0.351s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a9b590-9979-4fcb-9a93-a382c08d3800]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:52 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce745021-6390-44b5-9e8a-288040c3e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3518dc8a-0ef9-469a-8c9a-436b69898de4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdb667-09a7-4efb-a44f-f3b39b965ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" returned: 0 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Volume volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 (3518dc8a-0ef9-469a-8c9a-436b69898de4): created successfully Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00bdb667-09a7-4efb-a44f-f3b39b965ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:52 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8 Aug 26 00:11:52 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Flow 'volume_create_manager' (fc24a018-e764-4ad3-8770-1e0e747c9063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e3462574-1772-41a8-bbdd-9bf8b9463bc5 tempest-ServersNegativeTestJSON-761361667 None] Created volume successfully. Aug 26 00:11:52 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:52 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:52 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" returned: 0 in 0.275s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-quobyte-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8" released by "delete_volume" :: held 0.750s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Created reservations ['27743780-54e2-4797-96b6-122f21005e1c', 'bc87452c-adc8-45ff-9f9c-fbe8663f4f04', '08466482-1c61-4543-a9d1-3203d0e08994', '71ff6971-7c82-4bde-9803-06d99928e82d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:52 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.393s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:52 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 Aug 26 00:11:52 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:52 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:52 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "cinder-45441744-ecd5-4f8b-86b4-b4aa4f0fec55-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-45441744-ecd5-4f8b-86b4-b4aa4f0fec55-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "cinder-quobyte-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-quobyte-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" acquired by "delete_volume" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d3be15-457e-429d-9e2d-397ca93e2f23]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:52 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2" returned: 0 in 0.615s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:53 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2 Aug 26 00:11:53 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:53 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.543s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Deleted volume successfully. Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5d367c99-8c2a-49f6-bc9e-1894acc09a2c tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-91effd36-ef94-4e69-8a2e-d7b9ad5b05f8-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:53 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 Aug 26 00:11:53 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:53 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.1b310586-513b-4a9e-b9d2-5668b8a09fb2" returned: 0 in 0.547s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-1b310586-513b-4a9e-b9d2-5668b8a09fb2" released by "_delete_snapshot" :: held 2.121s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_snapshot" :: held 2.191s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:53 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" returned: 0 in 0.752s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Created reservations ['351ca2ba-576b-4527-abe1-6b8e0e3f667d', '3d5d5a4b-7edf-43c9-81e0-fc524ddb47df', 'cd666313-e5d7-42e3-aed3-bc73f043f21e', 'c4afca4a-4fec-489c-9e25-d489438a82cc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:53 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55 Aug 26 00:11:53 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Delete snapshot completed successfully. Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-82ceeb5a-560b-4216-bce3-3879efb66b12 tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-1b310586-513b-4a9e-b9d2-5668b8a09fb2-delete_snapshot" released by "delete_snapshot" :: held 2.404s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:53 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" returned: 0 in 0.282s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-quobyte-45441744-ecd5-4f8b-86b4-b4aa4f0fec55" released by "delete_volume" :: held 1.092s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Created reservations ['17022271-b4a8-41f9-86e1-6ebffa0dd60f', 'ddb888a5-e673-4487-8d37-caa1d018e433', '56d12675-daa8-4763-91c8-74e543f7fc3f', '5e786f10-bc83-4440-91ff-d7f8dec042da'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:54 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:54 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:54 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Deleted volume successfully. Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Flow 'volume_create_manager' (df61acf0-588c-44fc-8724-bf78602fde36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29d5073-d2e6-4aa6-9a79-3b4bcb571b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cf262c4-c946-4bc1-9d93-fc15c3eaabcd tempest-TestServerVolumeAttachmentScenario-1758870752 None] Lock "cinder-45441744-ecd5-4f8b-86b4-b4aa4f0fec55-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29d5073-d2e6-4aa6-9a79-3b4bcb571b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1775547409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724895e5-4e5e-4b8d-8605-ab07be0a6c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7e30d8d2244bfcae7e225dc9654f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:54Z,use_quota=True,user_id='b4f8c1f6024640359a9c1ae12e2f0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff6ecf5-29b1-4751-aa19-8edbfcd588de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff6ecf5-29b1-4751-aa19-8edbfcd588de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d15fb59-e538-48d6-94cf-14f03367581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d15fb59-e538-48d6-94cf-14f03367581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724895e5-4e5e-4b8d-8605-ab07be0a6c13', 'volume_name': 'volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b285f9-fb7d-495c-951c-86ce036d210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b285f9-fb7d-495c-951c-86ce036d210a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3ab380-0959-4f86-961d-4bb4360fb3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:54 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Volume 724895e5-4e5e-4b8d-8605-ab07be0a6c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13', 'volume_size': 1} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1775547409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724895e5-4e5e-4b8d-8605-ab07be0a6c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7e30d8d2244bfcae7e225dc9654f5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:11:54Z,use_quota=True,user_id='b4f8c1f6024640359a9c1ae12e2f0a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Creating volume 724895e5-4e5e-4b8d-8605-ab07be0a6c13 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:11:54 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:54 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 1073741824 Aug 26 00:11:54 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:55 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 1073741824" returned: 0 in 0.507s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:55 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 Aug 26 00:11:55 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:55 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13" returned: 0 in 0.301s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.467s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Creating offline snapshot de902560-4e7a-44cd-b7e4-4163d69e039f of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f3ab380-0959-4f86-961d-4bb4360fb3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de83572-678e-46a2-a60a-d622dafeeb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ccf8c-09d8-4cff-856b-e4bc35b74f5a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:55 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Volume volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 (724895e5-4e5e-4b8d-8605-ab07be0a6c13): created successfully Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de83572-678e-46a2-a60a-d622dafeeb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:11:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Flow 'volume_create_manager' (df61acf0-588c-44fc-8724-bf78602fde36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:11:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8265c1a5-af7c-4fde-9fce-ff5dd67ebe3f tempest-ServersNegativeTestJSON-761361667 None] Created volume successfully. Aug 26 00:11:55 devstack sudo[103516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:55 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:55 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.548s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:56 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f 1G Aug 26 00:11:56 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:56 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f 1G" returned: 0 in 0.553s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:56 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f Aug 26 00:11:56 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:56 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "cinder-724895e5-4e5e-4b8d-8605-ab07be0a6c13-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f" returned: 0 in 0.338s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:56 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f is being set with open permissions: ugo+rw Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-724895e5-4e5e-4b8d-8605-ab07be0a6c13-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:56 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f Aug 26 00:11:56 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "cinder-quobyte-724895e5-4e5e-4b8d-8605-ab07be0a6c13" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-quobyte-724895e5-4e5e-4b8d-8605-ab07be0a6c13" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6c53d1-6a8f-4d35-a886-51732b3b6934]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:57 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 Aug 26 00:11:57 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:57 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.879s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4fc1f9df-33e2-45a9-ab84-ff30599fe13b tempest-SnapshotsActionsTest-1587492695 None] Create snapshot completed successfully Aug 26 00:11:57 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:57 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13 Aug 26 00:11:57 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:57 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-724895e5-4e5e-4b8d-8605-ab07be0a6c13" returned: 0 in 0.294s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-quobyte-724895e5-4e5e-4b8d-8605-ab07be0a6c13" released by "delete_volume" :: held 0.723s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Created reservations ['4269c89b-afc8-4a60-8ac4-bef89cf7c0f7', '2967b784-c40a-4c11-9971-b9b2f2287b22', 'dea5a8e2-62e3-4e10-a822-d5fb9e4cb438', '92ac7a30-fd69-44c8-964a-24ec1522470f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:57 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:57 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:58 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "cinder-3518dc8a-0ef9-469a-8c9a-436b69898de4-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Deleted volume successfully. Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-3518dc8a-0ef9-469a-8c9a-436b69898de4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7fa0159b-df74-454f-8514-398d33148fa3 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-724895e5-4e5e-4b8d-8605-ab07be0a6c13-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-de902560-4e7a-44cd-b7e4-4163d69e039f-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "cinder-quobyte-3518dc8a-0ef9-469a-8c9a-436b69898de4" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-de902560-4e7a-44cd-b7e4-4163d69e039f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-quobyte-3518dc8a-0ef9-469a-8c9a-436b69898de4" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Acquiring lock "cinder-quobyte-de902560-4e7a-44cd-b7e4-4163d69e039f" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fc9d7b-e2d3-423f-8b3a-024456a8200c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-de902560-4e7a-44cd-b7e4-4163d69e039f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Deleting offline snapshot de902560-4e7a-44cd-b7e4-4163d69e039f of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] snapshot_file for this snap is: volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a9983-0b21-492d-80eb-8bb3dcb6b6fa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:58 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 Aug 26 00:11:58 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:58 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f Aug 26 00:11:58 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:58 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4" returned: 0 in 0.436s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:58 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4 Aug 26 00:11:58 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:58 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f" returned: 0 in 0.488s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde7749-2940-4523-ad82-b45ccb861ca7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:58 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:11:58 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:58 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3518dc8a-0ef9-469a-8c9a-436b69898de4" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-quobyte-3518dc8a-0ef9-469a-8c9a-436b69898de4" released by "delete_volume" :: held 0.774s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Created reservations ['325adcf2-2e2a-4584-b5ef-e411ab57db6f', '42fb59a8-6fe6-490e-8f61-0ef696e55823', '23ddbc44-5840-4244-9ddf-cd62ff63dd67', '4f240663-40c0-42c7-9964-0945a06dea57'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:59 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:11:59 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:59 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.475s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:59 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f Aug 26 00:11:59 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:11:59 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:11:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Deleted volume successfully. Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7a7ff9c4-7d05-46ed-9598-770b4732fa18 tempest-ServersNegativeTestJSON-761361667 None] Lock "cinder-3518dc8a-0ef9-469a-8c9a-436b69898de4-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:11:59 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f" returned: 0 in 0.569s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:11:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:11:59 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f Aug 26 00:11:59 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:00 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.de902560-4e7a-44cd-b7e4-4163d69e039f" returned: 0 in 0.431s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-de902560-4e7a-44cd-b7e4-4163d69e039f" released by "_delete_snapshot" :: held 2.111s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_snapshot" :: held 2.148s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:00 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Created reservations ['f8cdb208-313d-49ed-850c-424a2fc30ffe', 'e42026dd-8f43-4c63-a2fb-db537383a529', '75923efa-83e5-4ae4-9c1f-736ae96aded6', 'a6c2c00a-c224-47b6-82dc-e8f2c43e8516'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:12:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Delete snapshot completed successfully. Aug 26 00:12:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3804e286-0729-4ad3-afa9-70e7cca85b9a tempest-SnapshotsActionsTest-1933106068 None] Lock "cinder-de902560-4e7a-44cd-b7e4-4163d69e039f-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "cinder-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "cinder-quobyte-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Deleting offline snapshot 8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb of volume 0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] snapshot_file for this snap is: volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18cbc0c-99de-4d36-915d-12445bbe936c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:02 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:12:02 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:02 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.475s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0582d096-20d5-40e9-bcfa-4686e389c18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6884d9fe-fbd5-4c94-b38f-330159e03fc4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:02 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f Aug 26 00:12:02 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:03 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f" returned: 0 in 0.462s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:03 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:12:03 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:03 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.346s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:03 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb Aug 26 00:12:03 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:03 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f.8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb" released by "_delete_snapshot" :: held 1.739s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_snapshot" :: held 1.767s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Created reservations ['957c2356-2cd1-4b59-9737-f0018ef1d791', 'd555597d-01ed-477d-ad3f-1bdf804863c0', 'a1afadf7-7f23-4c8e-8bbb-999e1e2c6a53', '235fec50-1154-429e-b075-880a71d8e1e3'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:12:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Delete snapshot completed successfully. Aug 26 00:12:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2695f062-2d14-4f98-a7f6-aa4d97d7d1d9 tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-8ad1550e-fbfa-4c61-9eea-ca8c63b28cdb-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "cinder-0582d096-20d5-40e9-bcfa-4686e389c18f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-0582d096-20d5-40e9-bcfa-4686e389c18f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d3427c-583e-40b2-8107-0dbb62335cb2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:04 devstack sudo[103644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f Aug 26 00:12:04 devstack sudo[103644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:04 devstack sudo[103644]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f" returned: 0 in 0.492s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:04 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f Aug 26 00:12:04 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:05 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0582d096-20d5-40e9-bcfa-4686e389c18f" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-quobyte-0582d096-20d5-40e9-bcfa-4686e389c18f" released by "delete_volume" :: held 0.853s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Created reservations ['6fb406fb-038c-4c94-849d-817c9ebd2ab9', 'bc4445c7-bdea-45f2-bf86-b0b8aa3261ba', '9eb8f981-dd3c-4343-9566-5bda121bbe02', '6f6b6d4d-022e-435e-a988-ccc185f84e7b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:05 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:12:05 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:05 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:12:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Deleted volume successfully. Aug 26 00:12:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e611a2e-f8d2-4d5f-8835-3e8f771b648d tempest-SnapshotsActionsTest-1587492695 None] Lock "cinder-0582d096-20d5-40e9-bcfa-4686e389c18f-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-5174ee13-4f24-43a7-878a-156db7f36b16 req-a37dab8c-6eae-4477-945c-6acf77a74ac4 tempest-AttachVolumeNegativeTest-1984808805 None] Terminate volume connection completed successfully. Aug 26 00:12:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-5174ee13-4f24-43a7-878a-156db7f36b16 req-a37dab8c-6eae-4477-945c-6acf77a74ac4 tempest-AttachVolumeNegativeTest-1984808805 None] Deleting attachment db45d6b6-dbc6-4b02-a9f1-07ff793d3ada. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:12:23 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=66,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:12:23 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=74,cinder:UPDATE=77,cinder:DELETE=5,cinder:INSERT=25 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:12:24 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:12:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Flow 'volume_create_manager' (298d2acd-589d-4f0c-99cd-0449eb9d8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:12:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12d3262-6c1e-4cbb-9190-90442869fa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a12d3262-6c1e-4cbb-9190-90442869fa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-723821760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d065d422-103c-4de2-b7f7-726fa9df3571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51776ce3523048ddadc3b4f78996850c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:12:25Z,use_quota=True,user_id='90dabd6b67b9419097d2840ddbdcfaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8f1cb-9af3-483d-9805-e43d49155c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8f1cb-9af3-483d-9805-e43d49155c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dac26a8-9764-4a8e-bdd2-f74bfbe492c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dac26a8-9764-4a8e-bdd2-f74bfbe492c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd065d422-103c-4de2-b7f7-726fa9df3571', 'volume_name': 'volume-d065d422-103c-4de2-b7f7-726fa9df3571', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b4f028-0c54-4e58-989e-7f585b173680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b4f028-0c54-4e58-989e-7f585b173680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff7a763-06fb-4632-b1a4-682ecc6012a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Volume d065d422-103c-4de2-b7f7-726fa9df3571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d065d422-103c-4de2-b7f7-726fa9df3571', 'volume_size': 1} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-723821760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d065d422-103c-4de2-b7f7-726fa9df3571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51776ce3523048ddadc3b4f78996850c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:12:25Z,use_quota=True,user_id='90dabd6b67b9419097d2840ddbdcfaf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Creating volume d065d422-103c-4de2-b7f7-726fa9df3571 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:12:25 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:25 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 1073741824 Aug 26 00:12:25 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:25 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 1073741824" returned: 0 in 0.602s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:25 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 Aug 26 00:12:25 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:25 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571" returned: 0 in 0.297s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:12:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ff7a763-06fb-4632-b1a4-682ecc6012a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d065d422-103c-4de2-b7f7-726fa9df3571', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7df7e-53b4-4281-a2e4-025c9b529ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Volume volume-d065d422-103c-4de2-b7f7-726fa9df3571 (d065d422-103c-4de2-b7f7-726fa9df3571): created successfully Aug 26 00:12:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fa7df7e-53b4-4281-a2e4-025c9b529ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Flow 'volume_create_manager' (298d2acd-589d-4f0c-99cd-0449eb9d8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:12:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4e193d9e-f3af-467d-bca0-7f4c438e77ee tempest-VolumesServicesTestJSON-1833608481 None] Created volume successfully. Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Acquiring lock "cinder-d065d422-103c-4de2-b7f7-726fa9df3571-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "cinder-d065d422-103c-4de2-b7f7-726fa9df3571-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Acquiring lock "cinder-quobyte-d065d422-103c-4de2-b7f7-726fa9df3571" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "cinder-quobyte-d065d422-103c-4de2-b7f7-726fa9df3571" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afd14d9-ba77-4f46-b495-838a3cb5cfe0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:27 devstack sudo[103747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 Aug 26 00:12:27 devstack sudo[103747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:27 devstack sudo[103747]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:27 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571 Aug 26 00:12:27 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:28 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d065d422-103c-4de2-b7f7-726fa9df3571" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "cinder-quobyte-d065d422-103c-4de2-b7f7-726fa9df3571" released by "delete_volume" :: held 0.722s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Created reservations ['1b4dcd25-608a-49c6-a9ee-a7f79ab74f2b', '88e2b90c-da0a-407a-8c37-4c47781e96c6', 'a40ca38d-f11d-4f9f-9dc4-8857303987cf', 'bd3b18c0-ab25-49b6-8dfc-6254c76120a6'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:28 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:12:28 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:28 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.318s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:12:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Deleted volume successfully. Aug 26 00:12:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2008a8d-3792-4221-82ef-351d62d062cc tempest-VolumesServicesTestJSON-1833608481 None] Lock "cinder-d065d422-103c-4de2-b7f7-726fa9df3571-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Flow 'volume_create_manager' (4561d87e-b100-4c2c-98ce-24b04b9f3b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b922e-0590-4273-97c4-fcd815edea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b922e-0590-4273-97c4-fcd815edea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1686117242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7118fa-d449-4f90-b250-1f15eb9fd12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a44f66b85e47d89226ac625090149f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:12:37Z,use_quota=True,user_id='4502be16191249ebae74f570e8acb0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f26b97-f306-41cb-8e9b-9c6dc7c6f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f26b97-f306-41cb-8e9b-9c6dc7c6f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2befd-0676-42ef-b741-11b5a0ef7004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a2befd-0676-42ef-b741-11b5a0ef7004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb7118fa-d449-4f90-b250-1f15eb9fd12d', 'volume_name': 'volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4299ae-04e8-445f-bd78-6f9422cecb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4299ae-04e8-445f-bd78-6f9422cecb8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908eba8f-7bad-47cf-8a09-8f689be23366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Volume bb7118fa-d449-4f90-b250-1f15eb9fd12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d', 'volume_size': 1} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1686117242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb7118fa-d449-4f90-b250-1f15eb9fd12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16a44f66b85e47d89226ac625090149f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:12:37Z,use_quota=True,user_id='4502be16191249ebae74f570e8acb0f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Creating volume bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:12:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:37 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d 1073741824 Aug 26 00:12:37 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:37 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d 1073741824" returned: 0 in 0.672s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:38 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:12:38 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:38 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908eba8f-7bad-47cf-8a09-8f689be23366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f1db1-c358-41f5-ab0f-335cb035fc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:12:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Volume volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d (bb7118fa-d449-4f90-b250-1f15eb9fd12d): created successfully Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193f1db1-c358-41f5-ab0f-335cb035fc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:12:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Flow 'volume_create_manager' (4561d87e-b100-4c2c-98ce-24b04b9f3b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:12:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-446bae14-1c3e-43ae-b56b-757390ce0581 tempest-TestImageHashVerification-608560842 None] Created volume successfully. Aug 26 00:12:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be77f9e-776f-4e99-9d38-e5e6d2dfeb99]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:41 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:12:41 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:41 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.600s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee1dfa8-6a4e-4adf-878e-f0f490752884]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:41 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:12:41 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:42 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.451s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d /opt/stack/data/cinder/conversion/bb7118fa-d449-4f90-b250-1f15eb9fd12d.temp_image.b19d1508-463f-4be5-86c5-b5168509ad0eg2fqbime.img {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:42 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d /opt/stack/data/cinder/conversion/bb7118fa-d449-4f90-b250-1f15eb9fd12d.temp_image.b19d1508-463f-4be5-86c5-b5168509ad0eg2fqbime.img Aug 26 00:12:42 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:12:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:46 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:12:46 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:47 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.746s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:12:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:12:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:12:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:12:49 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d /opt/stack/data/cinder/conversion/bb7118fa-d449-4f90-b250-1f15eb9fd12d.temp_image.b19d1508-463f-4be5-86c5-b5168509ad0eg2fqbime.img" returned: 0 in 7.807s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4915c6f2-56ff-4279-9a8c-3af6caab962f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:12:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:12:49 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:12:49 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:12:50 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Aug 26 00:12:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.872s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:12:50 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d, size 1024.00 MB, duration 7.81 sec, destination /opt/stack/data/cinder/conversion/bb7118fa-d449-4f90-b250-1f15eb9fd12d.temp_image.b19d1508-463f-4be5-86c5-b5168509ad0eg2fqbime.img {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:12:50 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Converted 1024.00 MB image at 131.12 MB/s Aug 26 00:12:50 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] b19d1508-463f-4be5-86c5-b5168509ad0e was raw, no need to convert to raw {{(pid=94433) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 00:13:00 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=12,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=3 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:13:00 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Flow 'volume_create_manager' (9fe1d0e0-a36f-44c9-a8ef-d8034334cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe34b52-79bc-4374-86a8-cf04b658e534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe34b52-79bc-4374-86a8-cf04b658e534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-494024079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eda5133-0a30-4a32-b65d-435914bf7997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149286aa42f5495e879ffb92c407ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:04Z,use_quota=True,user_id='29778e4cd01944a48ac33de69b651cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663260e-10ce-425a-9add-79d256db3bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663260e-10ce-425a-9add-79d256db3bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7349d52-5d0d-42be-919d-7e3b5d5af36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7349d52-5d0d-42be-919d-7e3b5d5af36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7eda5133-0a30-4a32-b65d-435914bf7997', 'volume_name': 'volume-7eda5133-0a30-4a32-b65d-435914bf7997', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c093c7-0c73-4fef-b186-0476c0da045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40c093c7-0c73-4fef-b186-0476c0da045e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08e2742-d7e3-40b3-a19c-36df2891b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:03 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Volume 7eda5133-0a30-4a32-b65d-435914bf7997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7eda5133-0a30-4a32-b65d-435914bf7997', 'volume_size': 1} Aug 26 00:13:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:13 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (b28bbefe-382d-409c-911a-ee89bcaa070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ae402-2273-48e4-b98f-e39fd71b1363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c38ae402-2273-48e4-b98f-e39fd71b1363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-37455921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c98dc7d-713b-4d3e-8ee4-d12969751240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:14Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fcf215-02e2-4c27-b01f-eb0bed3dbbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fcf215-02e2-4c27-b01f-eb0bed3dbbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3d451-66e8-4c32-9290-576877bc1f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a3d451-66e8-4c32-9290-576877bc1f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c98dc7d-713b-4d3e-8ee4-d12969751240', 'volume_name': 'volume-9c98dc7d-713b-4d3e-8ee4-d12969751240', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7b978-166f-4cd0-a4b6-b2e6cdd71678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e7b978-166f-4cd0-a4b6-b2e6cdd71678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0533274-f645-4ee9-b668-3329cf2c8bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Volume 9c98dc7d-713b-4d3e-8ee4-d12969751240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c98dc7d-713b-4d3e-8ee4-d12969751240', 'volume_size': 1} Aug 26 00:13:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 37.352s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Uploaded volume to glance image-id: b19d1508-463f-4be5-86c5-b5168509ad0e. {{(pid=94433) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.484s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-494024079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eda5133-0a30-4a32-b65d-435914bf7997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='149286aa42f5495e879ffb92c407ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:04Z,use_quota=True,user_id='29778e4cd01944a48ac33de69b651cd8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Creating volume 7eda5133-0a30-4a32-b65d-435914bf7997 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:13:18 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:18 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 1073741824 Aug 26 00:13:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6b92fcad-2956-455d-b3d5-b1b742e94f00 tempest-TestImageHashVerification-608560842 None] Copy volume to image completed successfully. Aug 26 00:13:18 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:18 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 1073741824" returned: 0 in 0.449s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:18 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 Aug 26 00:13:18 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Acquiring lock "cinder-bb7118fa-d449-4f90-b250-1f15eb9fd12d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "cinder-bb7118fa-d449-4f90-b250-1f15eb9fd12d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:19 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997" returned: 0 in 0.281s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.921s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-37455921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c98dc7d-713b-4d3e-8ee4-d12969751240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:14Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Creating volume 9c98dc7d-713b-4d3e-8ee4-d12969751240 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:13:19 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Acquiring lock "cinder-quobyte-bb7118fa-d449-4f90-b250-1f15eb9fd12d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c08e2742-d7e3-40b3-a19c-36df2891b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eda5133-0a30-4a32-b65d-435914bf7997', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:19 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 1073741824 Aug 26 00:13:19 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f007322-e9f2-4348-b935-89c8b9cff552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "cinder-quobyte-bb7118fa-d449-4f90-b250-1f15eb9fd12d" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Volume volume-7eda5133-0a30-4a32-b65d-435914bf7997 (7eda5133-0a30-4a32-b65d-435914bf7997): created successfully Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f007322-e9f2-4348-b935-89c8b9cff552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Flow 'volume_create_manager' (9fe1d0e0-a36f-44c9-a8ef-d8034334cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52bcd67-655f-4bce-b47c-0e4f12eb172c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-38003b60-55fb-469c-bbc8-1bcaace7ca3d tempest-AbsoluteLimitsTests-824699605 None] Created volume successfully. Aug 26 00:13:19 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:13:19 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:19 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:19 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 1073741824" returned: 0 in 0.483s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:19 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d Aug 26 00:13:19 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:19 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 Aug 26 00:13:19 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Acquiring lock "cinder-7eda5133-0a30-4a32-b65d-435914bf7997-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "cinder-7eda5133-0a30-4a32-b65d-435914bf7997-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:19 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb7118fa-d449-4f90-b250-1f15eb9fd12d" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "cinder-quobyte-bb7118fa-d449-4f90-b250-1f15eb9fd12d" released by "delete_volume" :: held 0.736s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Acquiring lock "cinder-quobyte-7eda5133-0a30-4a32-b65d-435914bf7997" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:19 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240" returned: 0 in 0.282s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0533274-f645-4ee9-b668-3329cf2c8bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c98dc7d-713b-4d3e-8ee4-d12969751240', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7c982d-b313-4538-81f6-532241bb002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "cinder-quobyte-7eda5133-0a30-4a32-b65d-435914bf7997" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Volume volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 (9c98dc7d-713b-4d3e-8ee4-d12969751240): created successfully Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b7c982d-b313-4538-81f6-532241bb002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (b28bbefe-382d-409c-911a-ee89bcaa070e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86f5c2f-df1d-4f75-836e-7c88189b151e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:19 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Created reservations ['efddb32d-855c-4d5d-a342-61d493c43f86', '61951d59-dde5-4193-bc47-dbee5ba5c9c2', 'ed782be7-9ed4-4269-8cbd-a842d32039e8', 'a3a125ae-86bb-4eaf-99ae-168fa1f50b85'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:13:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a86158d1-8c1b-4230-8d40-fc74b6b4007a tempest-AttachVolumeNegativeTest-1984808805 None] Created volume successfully. Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:20 devstack sudo[104141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 Aug 26 00:13:20 devstack sudo[104141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:20 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:13:20 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:20 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.321s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:13:20 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Deleted volume successfully. Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1f0f103d-5662-4bdd-b673-813f14c0ad5b tempest-TestImageHashVerification-608560842 None] Lock "cinder-bb7118fa-d449-4f90-b250-1f15eb9fd12d-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:20 devstack sudo[104141]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997" returned: 0 in 0.512s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:20 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997 Aug 26 00:13:20 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:20 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7eda5133-0a30-4a32-b65d-435914bf7997" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "cinder-quobyte-7eda5133-0a30-4a32-b65d-435914bf7997" released by "delete_volume" :: held 0.929s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:20 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Created reservations ['e4ed726e-f317-4246-b1de-3bfb47f80061', 'f6c954e4-bd67-4c54-8598-47f07e26bceb', 'eecb895a-8977-4457-9948-8c816ba08581', 'c74169a5-0d85-46d7-9c2a-85d85d57b36a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:21 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:13:21 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (f417b932-26b5-4889-9818-54861629d3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2472894-50f5-4815-a3c3-a36d99074265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2472894-50f5-4815-a3c3-a36d99074265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-331551951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66d969a-b993-4b56-ba9c-14045e6785b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:21Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3d8b10-055b-4c53-9939-355f3db296b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3d8b10-055b-4c53-9939-355f3db296b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebba1cc6-9167-4c3f-b9ce-7dd82d7ea5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebba1cc6-9167-4c3f-b9ce-7dd82d7ea5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66d969a-b993-4b56-ba9c-14045e6785b2', 'volume_name': 'volume-c66d969a-b993-4b56-ba9c-14045e6785b2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517892fe-5268-4b2a-a90e-525443c86a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (517892fe-5268-4b2a-a90e-525443c86a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092b048e-dccd-4d45-a1c9-869908c4399e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Volume c66d969a-b993-4b56-ba9c-14045e6785b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66d969a-b993-4b56-ba9c-14045e6785b2', 'volume_size': 1} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-331551951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66d969a-b993-4b56-ba9c-14045e6785b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:21Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Creating volume c66d969a-b993-4b56-ba9c-14045e6785b2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:13:21 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:21 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 1073741824 Aug 26 00:13:21 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-85b54d22-5050-45ab-926e-62231468f06e req-858b8b46-a41c-48b2-bfc3-c5fd642cca1f tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:21 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:13:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Deleted volume successfully. Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d154e7a-1da7-4108-a7a3-d22032855c91 tempest-AbsoluteLimitsTests-824699605 None] Lock "cinder-7eda5133-0a30-4a32-b65d-435914bf7997-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:21 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 1073741824" returned: 0 in 0.493s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:21 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 Aug 26 00:13:21 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:22 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2" returned: 0 in 0.318s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-85b54d22-5050-45ab-926e-62231468f06e req-858b8b46-a41c-48b2-bfc3-c5fd642cca1f tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.814s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092b048e-dccd-4d45-a1c9-869908c4399e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66d969a-b993-4b56-ba9c-14045e6785b2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3979ec-9f8d-435c-ad65-84f80c98d66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-85b54d22-5050-45ab-926e-62231468f06e req-858b8b46-a41c-48b2-bfc3-c5fd642cca1f tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:22 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Volume volume-c66d969a-b993-4b56-ba9c-14045e6785b2 (c66d969a-b993-4b56-ba9c-14045e6785b2): created successfully Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a3979ec-9f8d-435c-ad65-84f80c98d66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (f417b932-26b5-4889-9818-54861629d3f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-094c5a86-b5db-43ef-a87d-e7642fa2f50a tempest-AttachVolumeTestJSON-1871664473 None] Created volume successfully. Aug 26 00:13:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-85b54d22-5050-45ab-926e-62231468f06e req-858b8b46-a41c-48b2-bfc3-c5fd642cca1f tempest-AttachVolumeNegativeTest-1984808805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-9c98dc7d-713b-4d3e-8ee4-d12969751240', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd755a2b6-134f-438a-a8d2-c5d2709bd4d9', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:13:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-85b54d22-5050-45ab-926e-62231468f06e req-858b8b46-a41c-48b2-bfc3-c5fd642cca1f tempest-AttachVolumeNegativeTest-1984808805 None] attachment_update completed successfully. Aug 26 00:13:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fbe2f716-d032-4b07-8aee-c92a632a7d68 req-ffaac322-417a-4037-b35a-5accfc0ae56f tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fbe2f716-d032-4b07-8aee-c92a632a7d68 req-ffaac322-417a-4037-b35a-5accfc0ae56f tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-fbe2f716-d032-4b07-8aee-c92a632a7d68 req-ffaac322-417a-4037-b35a-5accfc0ae56f tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-fbe2f716-d032-4b07-8aee-c92a632a7d68 req-ffaac322-417a-4037-b35a-5accfc0ae56f tempest-AttachVolumeTestJSON-1871664473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-c66d969a-b993-4b56-ba9c-14045e6785b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fd0a4ea-5273-422a-91cc-3f5eb6b2639e', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:13:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-fbe2f716-d032-4b07-8aee-c92a632a7d68 req-ffaac322-417a-4037-b35a-5accfc0ae56f tempest-AttachVolumeTestJSON-1871664473 None] attachment_update completed successfully. Aug 26 00:13:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-181d5bff-49c1-4fd7-a8ad-1d6655b2f87a req-2f930c06-ec68-4b0d-b020-21810420e4c4 tempest-AttachVolumeNegativeTest-1984808805 None] Terminate volume connection completed successfully. Aug 26 00:13:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-181d5bff-49c1-4fd7-a8ad-1d6655b2f87a req-2f930c06-ec68-4b0d-b020-21810420e4c4 tempest-AttachVolumeNegativeTest-1984808805 None] Deleting attachment d755a2b6-134f-438a-a8d2-c5d2709bd4d9. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Flow 'volume_create_manager' (c32a67ed-0665-4311-98e6-44f46d3d912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba0e037-944f-4c42-ab8d-dcbd915dd6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eba0e037-944f-4c42-ab8d-dcbd915dd6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-968646744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284d050-09bd-466d-9e5d-652c83fdcaa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea466e8c9cc4e83b0ce32d21912ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:30Z,use_quota=True,user_id='1531c3dd68894cac8a0631603184fcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67090c0c-38a5-46ae-b4e3-d2eb077f19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67090c0c-38a5-46ae-b4e3-d2eb077f19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022890a8-958f-4385-9536-60a2801cf185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022890a8-958f-4385-9536-60a2801cf185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd284d050-09bd-466d-9e5d-652c83fdcaa2', 'volume_name': 'volume-d284d050-09bd-466d-9e5d-652c83fdcaa2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d0d467-0dbe-45d4-951d-123b408729a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87d0d467-0dbe-45d4-951d-123b408729a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55970fd-cb37-4697-83c2-8323643c292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Volume d284d050-09bd-466d-9e5d-652c83fdcaa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d284d050-09bd-466d-9e5d-652c83fdcaa2', 'volume_size': 1} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-968646744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d284d050-09bd-466d-9e5d-652c83fdcaa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea466e8c9cc4e83b0ce32d21912ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:30Z,use_quota=True,user_id='1531c3dd68894cac8a0631603184fcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Creating volume d284d050-09bd-466d-9e5d-652c83fdcaa2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:13:30 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:13:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:30 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 1073741824 Aug 26 00:13:30 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:31 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 1073741824" returned: 0 in 0.869s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:31 devstack sudo[104725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 Aug 26 00:13:31 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:31 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55970fd-cb37-4697-83c2-8323643c292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d284d050-09bd-466d-9e5d-652c83fdcaa2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127237e2-b55c-4671-a69d-5e177a18d238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Volume volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 (d284d050-09bd-466d-9e5d-652c83fdcaa2): created successfully Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127237e2-b55c-4671-a69d-5e177a18d238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Flow 'volume_create_manager' (c32a67ed-0665-4311-98e6-44f46d3d912d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f7312dc7-d8aa-4cea-ae15-f7b6713c4a03 tempest-VolumesTransfersTest-1117458216 None] Created volume successfully. Aug 26 00:13:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-407fb33c-c234-42bb-85cf-0e98d0523aea tempest-VolumesTransfersTest-1277957359 None] Transfer volume completed successfully. Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "cinder-d284d050-09bd-466d-9e5d-652c83fdcaa2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-d284d050-09bd-466d-9e5d-652c83fdcaa2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "cinder-quobyte-d284d050-09bd-466d-9e5d-652c83fdcaa2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-quobyte-d284d050-09bd-466d-9e5d-652c83fdcaa2" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca0deb1-4909-471f-b49f-127efe3ae2aa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:13:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:35 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 Aug 26 00:13:35 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:35 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2" returned: 0 in 0.632s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:35 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2 Aug 26 00:13:35 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:36 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d284d050-09bd-466d-9e5d-652c83fdcaa2" returned: 0 in 0.557s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-quobyte-d284d050-09bd-466d-9e5d-652c83fdcaa2" released by "delete_volume" :: held 1.261s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Created reservations ['882f6810-5efc-458c-9ed0-b2f64c2d9fa3', '79222e57-4341-42da-9107-3ff36b32bdc8', '030e46a4-1528-422f-a7c3-de9f77ae552b', '82e3ec0a-3963-4293-9a67-161604ac45f0'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:36 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:13:36 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:36 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:13:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Deleted volume successfully. Aug 26 00:13:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f13c5079-223b-4372-b38f-35375b7d5fd2 tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-d284d050-09bd-466d-9e5d-652c83fdcaa2-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Flow 'volume_create_manager' (e8fa4bde-d937-4af5-9524-49e65eb64935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a1dd27-35f9-4cab-abbe-7537b94ff428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a1dd27-35f9-4cab-abbe-7537b94ff428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1144331164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a27743a-0915-40e0-8e49-a8f4516b5533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea466e8c9cc4e83b0ce32d21912ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:38Z,use_quota=True,user_id='1531c3dd68894cac8a0631603184fcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3a624f-a85c-43b7-80ff-3c20bc591302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc3a624f-a85c-43b7-80ff-3c20bc591302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cde46b-28ca-4cf6-952f-9e27f130e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31cde46b-28ca-4cf6-952f-9e27f130e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a27743a-0915-40e0-8e49-a8f4516b5533', 'volume_name': 'volume-8a27743a-0915-40e0-8e49-a8f4516b5533', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbc3f95-6d1a-4466-ab3c-70aabef9c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbc3f95-6d1a-4466-ab3c-70aabef9c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3feee99a-ae19-4644-b151-f2e54ef57e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Volume 8a27743a-0915-40e0-8e49-a8f4516b5533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a27743a-0915-40e0-8e49-a8f4516b5533', 'volume_size': 1} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1144331164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a27743a-0915-40e0-8e49-a8f4516b5533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea466e8c9cc4e83b0ce32d21912ab62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:13:38Z,use_quota=True,user_id='1531c3dd68894cac8a0631603184fcae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Creating volume 8a27743a-0915-40e0-8e49-a8f4516b5533 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:13:38 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:13:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:38 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 1073741824 Aug 26 00:13:38 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:39 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 1073741824" returned: 0 in 0.928s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:39 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 Aug 26 00:13:39 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:39 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533" returned: 0 in 0.526s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3feee99a-ae19-4644-b151-f2e54ef57e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a27743a-0915-40e0-8e49-a8f4516b5533', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a5000f-998c-45c1-a302-3bdb1fe707c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:13:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Volume volume-8a27743a-0915-40e0-8e49-a8f4516b5533 (8a27743a-0915-40e0-8e49-a8f4516b5533): created successfully Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a5000f-998c-45c1-a302-3bdb1fe707c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:13:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Flow 'volume_create_manager' (e8fa4bde-d937-4af5-9524-49e65eb64935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:13:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-26dddf12-40ee-4960-b396-9419f30a3607 tempest-VolumesTransfersTest-1117458216 None] Created volume successfully. Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "cinder-8a27743a-0915-40e0-8e49-a8f4516b5533-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-8a27743a-0915-40e0-8e49-a8f4516b5533-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "cinder-quobyte-8a27743a-0915-40e0-8e49-a8f4516b5533" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-quobyte-8a27743a-0915-40e0-8e49-a8f4516b5533" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2419ec5-a340-40fd-adb7-8e41876d3cb6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:13:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:41 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 Aug 26 00:13:41 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:41 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533" returned: 0 in 0.587s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:41 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533 Aug 26 00:13:41 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:41 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8a27743a-0915-40e0-8e49-a8f4516b5533" returned: 0 in 0.414s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-quobyte-8a27743a-0915-40e0-8e49-a8f4516b5533" released by "delete_volume" :: held 1.085s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Created reservations ['a8d1bb8a-47ee-4869-a25a-74662c2b2496', 'bd925b09-ec7b-48ae-8d46-e37edd879b3f', '491f8828-998a-4da6-b3b1-41224a49b6c7', '65d8ce34-f9fd-472a-86e8-d63aca8a8fff'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:42 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:13:42 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:42 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:13:42 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Deleted volume successfully. Aug 26 00:13:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ed30b43-2d31-40c0-b28d-8b4ac56dce0e tempest-VolumesTransfersTest-1346700955 None] Lock "cinder-8a27743a-0915-40e0-8e49-a8f4516b5533-delete_volume" released by "delete_volume" :: held 1.762s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:13:46 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:13:46 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:13:46 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.420s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:13:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:13:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:13:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:13:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:13:52 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=37,cinder:UPDATE=52,cinder:INSERT=10,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:13:52 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=51,cinder:UPDATE=48,cinder:INSERT=11,cinder:DELETE=3 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:14:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-2c448a40-c421-4049-b49b-8012a1b29780 req-c5722807-5161-438c-a79f-1c94b7780c24 tempest-AttachVolumeTestJSON-1871664473 None] Terminate volume connection completed successfully. Aug 26 00:14:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-2c448a40-c421-4049-b49b-8012a1b29780 req-c5722807-5161-438c-a79f-1c94b7780c24 tempest-AttachVolumeTestJSON-1871664473 None] Deleting attachment 8fd0a4ea-5273-422a-91cc-3f5eb6b2639e. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:14:10 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:14:10 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Flow 'volume_create_manager' (9c8c3e55-2672-4ea1-a018-a871f9475b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2696620-9e6f-4181-9f4c-4cfde3597b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2696620-9e6f-4181-9f4c-4cfde3597b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-157100748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178bc069-758d-48e5-b02f-0f3c9180926f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e400388d4df841acb1dbcc92aa5dcca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:13Z,use_quota=True,user_id='e9ceda1ce4ae416ba5e4f1cec7468889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1031db54-120d-4a9c-9487-2f85c5b3d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1031db54-120d-4a9c-9487-2f85c5b3d950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9272f44b-d6e5-47f3-bf0e-7ebe37b5051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9272f44b-d6e5-47f3-bf0e-7ebe37b5051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '178bc069-758d-48e5-b02f-0f3c9180926f', 'volume_name': 'volume-178bc069-758d-48e5-b02f-0f3c9180926f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae5e203-930f-4d58-89f6-8ae281117198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae5e203-930f-4d58-89f6-8ae281117198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f4ef56-7077-4c97-adfd-ece710a97430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:12 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Volume 178bc069-758d-48e5-b02f-0f3c9180926f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-178bc069-758d-48e5-b02f-0f3c9180926f', 'volume_size': 1} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-157100748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=178bc069-758d-48e5-b02f-0f3c9180926f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e400388d4df841acb1dbcc92aa5dcca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:13Z,use_quota=True,user_id='e9ceda1ce4ae416ba5e4f1cec7468889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Creating volume 178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:14:12 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:14:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:12 devstack sudo[105442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f 1073741824 Aug 26 00:14:12 devstack sudo[105442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:13 devstack sudo[105442]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f 1073741824" returned: 0 in 0.654s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:13 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:14:13 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:14 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.470s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54f4ef56-7077-4c97-adfd-ece710a97430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-178bc069-758d-48e5-b02f-0f3c9180926f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f062bf-eb13-4e04-bae0-7ff5057c1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Volume volume-178bc069-758d-48e5-b02f-0f3c9180926f (178bc069-758d-48e5-b02f-0f3c9180926f): created successfully Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f062bf-eb13-4e04-bae0-7ff5057c1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Flow 'volume_create_manager' (9c8c3e55-2672-4ea1-a018-a871f9475b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6782700a-566e-4b65-8dbc-2f0549b50bf1 tempest-TestStampPattern-397745456 None] Created volume successfully. Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (a75cd9d2-44a9-43ba-a29f-16b47f410dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b5b79-5a4c-4168-9902-c498c30a5497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588b5b79-5a4c-4168-9902-c498c30a5497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-580290176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107579b7-2f0e-487b-8b9e-d938b19966db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:15Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3ca5d-0335-439c-a8dd-eea9d6d62b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec3ca5d-0335-439c-a8dd-eea9d6d62b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f18c17-d6a9-477c-9d65-16eb3b238eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f18c17-d6a9-477c-9d65-16eb3b238eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107579b7-2f0e-487b-8b9e-d938b19966db', 'volume_name': 'volume-107579b7-2f0e-487b-8b9e-d938b19966db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91665701-1cc9-4293-b644-942ad8b126e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91665701-1cc9-4293-b644-942ad8b126e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994e22e8-34da-4655-83c1-20936222678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:15 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Volume 107579b7-2f0e-487b-8b9e-d938b19966db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107579b7-2f0e-487b-8b9e-d938b19966db', 'volume_size': 1} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-580290176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107579b7-2f0e-487b-8b9e-d938b19966db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bd1caca48949c9aa353cca9a7ee271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:15Z,use_quota=True,user_id='0de2601e832c4701ad489dbab990d4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Creating volume 107579b7-2f0e-487b-8b9e-d938b19966db {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:14:15 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:14:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:15 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db 1073741824 Aug 26 00:14:15 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:16 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db 1073741824" returned: 0 in 0.875s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:16 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db Aug 26 00:14:16 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:16 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db" returned: 0 in 0.685s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:14:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (994e22e8-34da-4655-83c1-20936222678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107579b7-2f0e-487b-8b9e-d938b19966db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8301699-837b-4bfb-b155-40ae47d7fc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:17 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Volume volume-107579b7-2f0e-487b-8b9e-d938b19966db (107579b7-2f0e-487b-8b9e-d938b19966db): created successfully Aug 26 00:14:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8301699-837b-4bfb-b155-40ae47d7fc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Flow 'volume_create_manager' (a75cd9d2-44a9-43ba-a29f-16b47f410dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e815d8bd-7506-4bde-9a60-40c9358dfeb3 tempest-AttachVolumeNegativeTest-1984808805 None] Created volume successfully. Aug 26 00:14:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-77a0ec54-1906-458a-ba68-e9f12e2a08a0 req-5acbd1ef-95fc-4da9-a259-7544c0009382 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-77a0ec54-1906-458a-ba68-e9f12e2a08a0 req-5acbd1ef-95fc-4da9-a259-7544c0009382 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-77a0ec54-1906-458a-ba68-e9f12e2a08a0 req-5acbd1ef-95fc-4da9-a259-7544c0009382 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-77a0ec54-1906-458a-ba68-e9f12e2a08a0 req-5acbd1ef-95fc-4da9-a259-7544c0009382 tempest-AttachVolumeNegativeTest-1984808805 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-107579b7-2f0e-487b-8b9e-d938b19966db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55e9648d-2097-4f13-9691-567458da2017', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:14:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-77a0ec54-1906-458a-ba68-e9f12e2a08a0 req-5acbd1ef-95fc-4da9-a259-7544c0009382 tempest-AttachVolumeNegativeTest-1984808805 None] attachment_update completed successfully. Aug 26 00:14:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9780110c-8eff-481e-92e9-cda7ff7ccb3b req-55099bac-a85e-4112-8993-dea3097d60d4 tempest-AttachVolumeNegativeTest-1984808805 None] Terminate volume connection completed successfully. Aug 26 00:14:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-9780110c-8eff-481e-92e9-cda7ff7ccb3b req-55099bac-a85e-4112-8993-dea3097d60d4 tempest-AttachVolumeNegativeTest-1984808805 None] Deleting attachment 55e9648d-2097-4f13-9691-567458da2017. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:14:33 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:14:33 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=10,cinder:UPDATE=8,cinder:INSERT=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Flow 'volume_create_manager' (34e5d278-fa7e-49ad-994f-bc56db650758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b732d9-8ee9-4c17-9ca2-bc6cbb8ca9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-107579b7-2f0e-487b-8b9e-d938b19966db-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b732d9-8ee9-4c17-9ca2-bc6cbb8ca9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-231086444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ffa4fa-bd02-40ba-9d4c-21f20e51ae95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b163a69dee4a0dbd8722ffc26b1402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:34Z,use_quota=True,user_id='1fc9cb12a9d74130956caa54a9044c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d271d671-b7c1-4ac8-84c3-bdd8264fb88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d271d671-b7c1-4ac8-84c3-bdd8264fb88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43964e5-32f0-4838-94dc-cd8b317a4d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-107579b7-2f0e-487b-8b9e-d938b19966db-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-quobyte-107579b7-2f0e-487b-8b9e-d938b19966db" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-107579b7-2f0e-487b-8b9e-d938b19966db" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff9e3ea-70fd-4eec-8c25-445cdfbd3b62]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:34 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db Aug 26 00:14:34 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:34 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db" returned: 0 in 0.473s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:34 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db Aug 26 00:14:34 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43964e5-32f0-4838-94dc-cd8b317a4d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'volume_name': 'volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79fd7d-e154-4b80-8fcf-198203a68060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee79fd7d-e154-4b80-8fcf-198203a68060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710b43e-2942-49c9-8da0-d812bfeca8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Trying to clone 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 from image 6c58b25c-448f-497b-9741-4b65985b8a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:14:35 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-107579b7-2f0e-487b-8b9e-d938b19966db" returned: 0 in 0.320s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-107579b7-2f0e-487b-8b9e-d938b19966db" released by "delete_volume" :: held 0.878s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Created reservations ['b1b89b33-e60d-4709-9c2f-7f1661ad12cc', '15481b6a-243a-4db9-b8b4-8da5b082c771', '31560dfd-816a-4460-9cc2-3452405bcddb', '0f274b7e-c3b6-47d1-96a1-aa448a8a30fc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:14:35 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Image download 20.69 MB at 20.69 MB/s Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[73243bb3-f351-4443-9e62-d6ad3309aef1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:35 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:14:35 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:35 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD Aug 26 00:14:35 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:35 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:14:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Deleted volume successfully. Aug 26 00:14:35 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c is fetched for user 1fc9cb12a9d74130956caa54a9044c78. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:14:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2ddcde56-cf4f-48f8-b9d3-03da4c7719d3 tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-107579b7-2f0e-487b-8b9e-d938b19966db-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c490724e-f53d-404b-87f4-03e16dfbe673]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:36 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD Aug 26 00:14:36 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:36 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-231086444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ffa4fa-bd02-40ba-9d4c-21f20e51ae95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b163a69dee4a0dbd8722ffc26b1402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:34Z,use_quota=True,user_id='1fc9cb12a9d74130956caa54a9044c78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Creating volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:14:36 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:36 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1073741824 Aug 26 00:14:36 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-9c98dc7d-713b-4d3e-8ee4-d12969751240-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-9c98dc7d-713b-4d3e-8ee4-d12969751240-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-quobyte-9c98dc7d-713b-4d3e-8ee4-d12969751240" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-9c98dc7d-713b-4d3e-8ee4-d12969751240" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77341ae-d9e1-4e02-9e23-6e756190c589]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:37 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 Aug 26 00:14:37 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:37 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1073741824" returned: 0 in 0.635s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:37 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 Aug 26 00:14:37 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:37 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:37 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240 Aug 26 00:14:37 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:37 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Attempting download of 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2639da1c-edf5-4cda-bad4-7d1ddf0f4681]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:37 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c98dc7d-713b-4d3e-8ee4-d12969751240" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-9c98dc7d-713b-4d3e-8ee4-d12969751240" released by "delete_volume" :: held 0.727s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Created reservations ['3d2309ac-dc2d-48db-9cbd-1f5e498862e6', '1eaff482-aa23-4c65-aaa5-6b9da86510bd', '55b49310-749c-45c1-b8f0-3a2282750db7', '6fe13381-1c0d-43d7-9138-18bfb401714c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:14:37 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l Aug 26 00:14:37 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:37 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:14:37 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:37 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:38 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l Aug 26 00:14:38 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:38 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.297s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:14:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Deleted volume successfully. Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2c2c4803-0063-4320-b6fc-ba05f6a719cb tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-9c98dc7d-713b-4d3e-8ee4-d12969751240-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-8864bc48-6f4e-44c7-b088-b6d79e7a0845-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-8864bc48-6f4e-44c7-b088-b6d79e7a0845-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:38 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l" returned: 1 in 0.390s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_wb5m090l' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e803a1f-4c70-41f6-8433-0ecd52af7328]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "cinder-quobyte-8864bc48-6f4e-44c7-b088-b6d79e7a0845" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-8864bc48-6f4e-44c7-b088-b6d79e7a0845" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[784fcf6c-7580-4bcf-8160-cc636004c74f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:38 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD Aug 26 00:14:38 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:38 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 Aug 26 00:14:38 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:38 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] 6c58b25c-448f-497b-9741-4b65985b8a7c was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:38 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 Aug 26 00:14:38 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:38 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845" returned: 0 in 0.358s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:38 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845 Aug 26 00:14:38 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:39 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8864bc48-6f4e-44c7-b088-b6d79e7a0845" returned: 0 in 0.307s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-quobyte-8864bc48-6f4e-44c7-b088-b6d79e7a0845" released by "delete_volume" :: held 0.726s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Created reservations ['9252b579-0998-4d3d-8346-ca2fa3ca5c9d', '89f64536-bd3c-4a36-8a24-a326c2761d15', '691dcd21-9db2-4a97-b89c-a89ec90431d7', 'cd578e24-cfda-4e24-bd38-661ffa822fb4'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:39 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:14:39 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:39 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.459s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:14:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Deleted volume successfully. Aug 26 00:14:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00f73dca-1c33-4ce7-a755-c5874614414c tempest-AttachVolumeNegativeTest-1984808805 None] Lock "cinder-8864bc48-6f4e-44c7-b088-b6d79e7a0845-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:14:41 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" returned: 0 in 2.713s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_glo8m90pdevstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:14:41 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Converted 112.00 MB image at 41.27 MB/s Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:41 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1G Aug 26 00:14:41 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:41 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 1G" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Downloaded image 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c for user 1fc9cb12a9d74130956caa54a9044c78 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Marking volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Copying metadata from image 6c58b25c-448f-497b-9741-4b65985b8a7c to 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Creating volume glance metadata for volume 01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 backed by image 6c58b25c-448f-497b-9741-4b65985b8a7c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e710b43e-2942-49c9-8da0-d812bfeca8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1e5987-02f4-4b53-bb4e-ed7d16e3bb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:41 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Volume volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 (01ffa4fa-bd02-40ba-9d4c-21f20e51ae95): created successfully Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1e5987-02f4-4b53-bb4e-ed7d16e3bb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Flow 'volume_create_manager' (34e5d278-fa7e-49ad-994f-bc56db650758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ff384a8d-a3bf-42b3-aa86-56facb17b342 tempest-TestShelveInstance-301450603 None] Created volume successfully. Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9b48a2dd-7da1-45e4-a6a6-3bb112d21356 req-7e917696-443e-4645-928c-6dc0d5bfccaf tempest-TestShelveInstance-301450603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9b48a2dd-7da1-45e4-a6a6-3bb112d21356 req-7e917696-443e-4645-928c-6dc0d5bfccaf tempest-TestShelveInstance-301450603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:46 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:14:46 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9b48a2dd-7da1-45e4-a6a6-3bb112d21356 req-7e917696-443e-4645-928c-6dc0d5bfccaf tempest-TestShelveInstance-301450603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.103s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-9b48a2dd-7da1-45e4-a6a6-3bb112d21356 req-7e917696-443e-4645-928c-6dc0d5bfccaf tempest-TestShelveInstance-301450603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26df71a6-5c8e-4745-97ca-0e841d9b6628', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:14:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9b48a2dd-7da1-45e4-a6a6-3bb112d21356 req-7e917696-443e-4645-928c-6dc0d5bfccaf tempest-TestShelveInstance-301450603 None] attachment_update completed successfully. Aug 26 00:14:46 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.427s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:14:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:14:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:14:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:14:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-ddc0132c-101e-4fe6-b904-103d92b775d9 req-5372be8c-ac48-4edf-99a0-735c6865bdd5 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-ddc0132c-101e-4fe6-b904-103d92b775d9 req-5372be8c-ac48-4edf-99a0-735c6865bdd5 tempest-TestStampPattern-397745456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-ddc0132c-101e-4fe6-b904-103d92b775d9 req-5372be8c-ac48-4edf-99a0-735c6865bdd5 tempest-TestStampPattern-397745456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-ddc0132c-101e-4fe6-b904-103d92b775d9 req-5372be8c-ac48-4edf-99a0-735c6865bdd5 tempest-TestStampPattern-397745456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-178bc069-758d-48e5-b02f-0f3c9180926f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c3e51bb-c0d4-4e11-a75e-9e0bf90aadef', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:14:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-ddc0132c-101e-4fe6-b904-103d92b775d9 req-5372be8c-ac48-4edf-99a0-735c6865bdd5 tempest-TestStampPattern-397745456 None] attachment_update completed successfully. Aug 26 00:14:53 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:14:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (84d363d7-ab79-42b1-a2a4-2905327278e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9378e37-4f0b-4e4a-aae8-faffd70fd287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9378e37-4f0b-4e4a-aae8-faffd70fd287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-603656403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8e30-0526-4e31-b247-3cd0d0804abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:54Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6b5d86-f213-4dd4-88a5-0e0797cfcea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6b5d86-f213-4dd4-88a5-0e0797cfcea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fecf14-0d47-4210-bde3-8b9b821b4866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fecf14-0d47-4210-bde3-8b9b821b4866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cc8e30-0526-4e31-b247-3cd0d0804abc', 'volume_name': 'volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf6606f-fa00-49c8-8dbb-611ee53246bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cf6606f-fa00-49c8-8dbb-611ee53246bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf1f854-0e24-43d8-b36b-9f3b31564467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:54 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Volume b7cc8e30-0526-4e31-b247-3cd0d0804abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc', 'volume_size': 1} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-603656403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cc8e30-0526-4e31-b247-3cd0d0804abc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:54Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Creating volume b7cc8e30-0526-4e31-b247-3cd0d0804abc {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:14:54 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:14:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:54 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc 1073741824 Aug 26 00:14:54 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:55 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc 1073741824" returned: 0 in 0.972s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:55 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc Aug 26 00:14:55 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:55 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc" returned: 0 in 0.586s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaf1f854-0e24-43d8-b36b-9f3b31564467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec01594-dbfd-4847-b6cd-885fc9c92dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:55 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Volume volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc (b7cc8e30-0526-4e31-b247-3cd0d0804abc): created successfully Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec01594-dbfd-4847-b6cd-885fc9c92dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (84d363d7-ab79-42b1-a2a4-2905327278e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a87c64a8-8866-4b5a-95dc-2558ef2b73ec tempest-VolumesTestJSON-1788941232 None] Created volume successfully. Aug 26 00:14:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-a7ba70d3-657b-4785-bbf1-90ea565b45dc req-8060d5e4-3957-4384-a365-818ca00da574 tempest-TestStampPattern-397745456 None] Terminate volume connection completed successfully. Aug 26 00:14:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-a7ba70d3-657b-4785-bbf1-90ea565b45dc req-8060d5e4-3957-4384-a365-818ca00da574 tempest-TestStampPattern-397745456 None] Deleting attachment 0c3e51bb-c0d4-4e11-a75e-9e0bf90aadef. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:14:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:14:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:14:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (f53c4614-925d-4400-adaa-27a96a15d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:14:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13810d06-cbd5-4252-93dd-26cad0ca811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Creating offline snapshot e67e61a5-a5a3-432a-a366-40f903a477ed of volume 178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13810d06-cbd5-4252-93dd-26cad0ca811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-308528016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:59Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43483b7-6669-455b-a87a-db7362c7f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43483b7-6669-455b-a87a-db7362c7f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd61f4b-8737-47a1-b199-42d06ff9b623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd61f4b-8737-47a1-b199-42d06ff9b623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c', 'volume_name': 'volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fc32f7-0f05-4225-bfe6-e230558ac56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fc32f7-0f05-4225-bfe6-e230558ac56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962bbe7-6b7b-4755-8897-e967fd4eb3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:14:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Volume 9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c', 'volume_size': 1} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cda132d-a78b-4d8a-bc27-2d61dec2af4a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:59 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:14:59 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:14:59 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.787s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:14:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:14:59 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed 1G Aug 26 00:14:59 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:00 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed 1G" returned: 0 in 0.635s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178bc069-758d-48e5-b02f-0f3c9180926f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:00 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178bc069-758d-48e5-b02f-0f3c9180926f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:15:00 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:01 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-178bc069-758d-48e5-b02f-0f3c9180926f -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.651s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:01 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed is being set with open permissions: ugo+rw Aug 26 00:15:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:01 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:15:01 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:01 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.509s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:01 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info Aug 26 00:15:01 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:02 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info" returned: 0 in 0.321s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:02 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info is being set with open permissions: ugo+rw Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:02 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info Aug 26 00:15:02 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:02 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.info" returned: 0 in 0.469s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.656s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.492s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-308528016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:14:59Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Creating volume 9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:02 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:15:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-14655d74-e552-4327-8e1b-b30ab3ce4515 tempest-TestStampPattern-397745456 None] Create snapshot completed successfully Aug 26 00:15:02 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c 1073741824 Aug 26 00:15:02 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:03 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c 1073741824" returned: 0 in 0.935s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:03 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c Aug 26 00:15:03 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:04 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" returned: 0 in 0.593s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2962bbe7-6b7b-4755-8897-e967fd4eb3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a88e75c-ca8c-4fe7-9444-03991472e041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:04 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Volume volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c (9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c): created successfully Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a88e75c-ca8c-4fe7-9444-03991472e041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (f53c4614-925d-4400-adaa-27a96a15d530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b0c618d6-e789-4980-a94a-2fcd162f3a5c tempest-VolumesTestJSON-1788941232 None] Created volume successfully. Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (272f4f37-4015-46a8-9be9-0186d8b20b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611b41a2-43e5-49a5-b384-127c83c8cafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611b41a2-43e5-49a5-b384-127c83c8cafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472941639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff54389-576d-4484-96d4-0f01b40adaf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:06Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a046d5c-af2e-45a3-a592-562b29c58320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a046d5c-af2e-45a3-a592-562b29c58320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d97f8-3f23-43ff-bb11-d19a8e3e34d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684d97f8-3f23-43ff-bb11-d19a8e3e34d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff54389-576d-4484-96d4-0f01b40adaf5', 'volume_name': 'volume-2ff54389-576d-4484-96d4-0f01b40adaf5', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0273f-c02b-4fe7-a68e-f30e5ba035f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d0273f-c02b-4fe7-a68e-f30e5ba035f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15be02e-a078-4425-a292-0669af0cc7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:05 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Volume 2ff54389-576d-4484-96d4-0f01b40adaf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff54389-576d-4484-96d4-0f01b40adaf5', 'volume_size': 1} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-472941639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ff54389-576d-4484-96d4-0f01b40adaf5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6d9a0605087b40f8b470e39fafc70928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:06Z,use_quota=True,user_id='fb942aec30fc4234a2b9b4f418cf2898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Creating volume 2ff54389-576d-4484-96d4-0f01b40adaf5 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:05 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:15:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:05 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 1073741824 Aug 26 00:15:05 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:06 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 1073741824" returned: 0 in 0.443s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:06 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 Aug 26 00:15:06 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:06 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5" returned: 0 in 0.339s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15be02e-a078-4425-a292-0669af0cc7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff54389-576d-4484-96d4-0f01b40adaf5', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736d7f5d-97e7-4a9b-8fcd-e6854b4c9b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Volume volume-2ff54389-576d-4484-96d4-0f01b40adaf5 (2ff54389-576d-4484-96d4-0f01b40adaf5): created successfully Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736d7f5d-97e7-4a9b-8fcd-e6854b4c9b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Flow 'volume_create_manager' (272f4f37-4015-46a8-9be9-0186d8b20b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-79b4f919-0261-4704-9821-020c681caaad tempest-VolumesTestJSON-1788941232 None] Created volume successfully. Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-2ff54389-576d-4484-96d4-0f01b40adaf5-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-2ff54389-576d-4484-96d4-0f01b40adaf5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-quobyte-2ff54389-576d-4484-96d4-0f01b40adaf5" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-2ff54389-576d-4484-96d4-0f01b40adaf5" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a173e2f-c32b-4597-9c3d-6658e2cfb113]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:09 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 Aug 26 00:15:09 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:09 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5" returned: 0 in 0.533s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:09 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5 Aug 26 00:15:09 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:10 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2ff54389-576d-4484-96d4-0f01b40adaf5" returned: 0 in 0.586s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-2ff54389-576d-4484-96d4-0f01b40adaf5" released by "delete_volume" :: held 1.183s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Created reservations ['3fc89c60-b6d9-4fc1-927f-747d313896e9', '874427fd-c269-4162-b876-3a0482ba8e02', '3de886eb-2a17-4027-a402-f52915973381', '67126490-cb27-4c73-8aac-d2dbb540aa9f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:10 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:10 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:11 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Deleted volume successfully. Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b0acf1bb-e425-4cc8-8de5-dcb12e20fad1 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-2ff54389-576d-4484-96d4-0f01b40adaf5-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-quobyte-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40e097-3fb9-463d-b7df-5fcdd66ee7cb]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:11 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c Aug 26 00:15:11 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:12 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" returned: 0 in 0.440s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:12 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c Aug 26 00:15:12 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:12 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" returned: 0 in 0.480s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c" released by "delete_volume" :: held 0.986s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Created reservations ['fa394d0e-5cc4-41c6-b9a8-8e1475813416', '86b96bd8-89a8-4086-8cbd-bbe72c2ec351', '21bd8071-6786-472d-8bef-ffc49d5e7af7', '9ead00e4-3812-46ed-892c-ff67ac866fe0'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:13 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:13 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Flow 'volume_create_manager' (3bee8b32-ad60-488e-becf-e8efd6e818ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502eaf6e-a4b1-4968-bef6-0104baf4a4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502eaf6e-a4b1-4968-bef6-0104baf4a4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-469552344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6064bd74-5025-4948-adbc-1cee9c9e51ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e400388d4df841acb1dbcc92aa5dcca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e67e61a5-a5a3-432a-a366-40f903a477ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:13Z,use_quota=True,user_id='e9ceda1ce4ae416ba5e4f1cec7468889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2874e7-5bb3-4ea7-acbf-0c561518fa61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2874e7-5bb3-4ea7-acbf-0c561518fa61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba9c162-4467-4889-a302-1dcf190f1dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba9c162-4467-4889-a302-1dcf190f1dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6064bd74-5025-4948-adbc-1cee9c9e51ee', 'volume_name': 'volume-6064bd74-5025-4948-adbc-1cee9c9e51ee', 'volume_size': 1, 'snapshot_id': 'e67e61a5-a5a3-432a-a366-40f903a477ed'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f73fe0f-8cbc-4b89-92e1-825bd810e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f73fe0f-8cbc-4b89-92e1-825bd810e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5314801f-0025-4120-a58d-b250fcb5c9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:13 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Volume 6064bd74-5025-4948-adbc-1cee9c9e51ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6064bd74-5025-4948-adbc-1cee9c9e51ee', 'volume_size': 1, 'snapshot_id': 'e67e61a5-a5a3-432a-a366-40f903a477ed'} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed-6064bd74-5025-4948-adbc-1cee9c9e51ee" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed-6064bd74-5025-4948-adbc-1cee9c9e51ee" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Creating volume 6064bd74-5025-4948-adbc-1cee9c9e51ee from snapshot e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] snapshot: e67e61a5-a5a3-432a-a366-40f903a477ed, volume: 6064bd74-5025-4948-adbc-1cee9c9e51ee, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:13 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.497s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Deleted volume successfully. Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b19a0f-d930-47d5-9f01-2ed6e24a9a43]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-adfb9526-f2c9-4e98-83df-5e128351d7c4 tempest-VolumesTestJSON-1788941232 None] Lock "cinder-9afc8b4f-5e1b-4f88-80e8-ab2b7ed0985c-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:13 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:15:13 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-b7cc8e30-0526-4e31-b247-3cd0d0804abc-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "cinder-b7cc8e30-0526-4e31-b247-3cd0d0804abc-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Acquiring lock "cinder-quobyte-b7cc8e30-0526-4e31-b247-3cd0d0804abc" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:14 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-b7cc8e30-0526-4e31-b247-3cd0d0804abc" acquired by "delete_volume" :: waited 0.031s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.629s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178bc069-758d-48e5-b02f-0f3c9180926f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d11aaa-38e6-47a2-9520-fd96a651cbf4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6798bdc8-aeea-4e03-be37-62a268c21014]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:14 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:15:14 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:14 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc Aug 26 00:15:14 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:14 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.533s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:14 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee Aug 26 00:15:14 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:14 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc" returned: 0 in 0.590s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:14 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc Aug 26 00:15:14 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:15 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cc8e30-0526-4e31-b247-3cd0d0804abc" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "cinder-quobyte-b7cc8e30-0526-4e31-b247-3cd0d0804abc" released by "delete_volume" :: held 1.030s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Created reservations ['0d1dfca7-bc6c-405d-9081-a67b45b0b7b1', 'e5c02201-381a-4a80-87fa-fc0a4afc7987', 'daf65929-da74-4578-b2eb-f9d2642f22c3', 'deb0f9fa-f5c8-4dda-819e-24db4e0aab20'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:15 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:15 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:15 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.608s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:15 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Deleted volume successfully. Aug 26 00:15:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c1072962-039a-4454-9819-b6c99e41ab2a tempest-VolumesTestJSON-1788941232 None] Lock "cinder-b7cc8e30-0526-4e31-b247-3cd0d0804abc-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:20 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee" returned: 0 in 6.186s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:20 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:15:20 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Converted 1024.00 MB image at 165.49 MB/s Aug 26 00:15:20 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee is being set with open permissions: ugo+rw Aug 26 00:15:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:20 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee Aug 26 00:15:20 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:21 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee" returned: 0 in 0.435s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" released by "_copy_volume_from_snapshot" :: held 7.962s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed-6064bd74-5025-4948-adbc-1cee9c9e51ee" released by "_create_volume_from_snapshot" :: held 8.074s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.098s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5314801f-0025-4120-a58d-b250fcb5c9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6064bd74-5025-4948-adbc-1cee9c9e51ee', 'volume_size': 1, 'snapshot_id': 'e67e61a5-a5a3-432a-a366-40f903a477ed'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37beae4-5bb8-4d60-b635-676bca94867e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Volume volume-6064bd74-5025-4948-adbc-1cee9c9e51ee (6064bd74-5025-4948-adbc-1cee9c9e51ee): created successfully Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e37beae4-5bb8-4d60-b635-676bca94867e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Flow 'volume_create_manager' (3bee8b32-ad60-488e-becf-e8efd6e818ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e5911159-8395-471d-ad7c-4de7d3016e2d tempest-TestStampPattern-397745456 None] Created volume successfully. Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (e8eeaa22-a4e5-47a5-9760-a39ff87f3e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590f2d15-380a-4673-9a46-6e72318d157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (590f2d15-380a-4673-9a46-6e72318d157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-120334264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cec1492-9891-4d25-bddd-a36d57f43dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:25Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d93b5d-3177-4fef-a115-4b03bf9bbd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d93b5d-3177-4fef-a115-4b03bf9bbd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615a188c-2741-4f5f-ae2b-4be25a1b10a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615a188c-2741-4f5f-ae2b-4be25a1b10a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cec1492-9891-4d25-bddd-a36d57f43dcf', 'volume_name': 'volume-6cec1492-9891-4d25-bddd-a36d57f43dcf', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14810882-b031-4533-9886-653d85c4855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14810882-b031-4533-9886-653d85c4855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f5f34a-53b0-463e-9e2b-9c8b7aef6598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:24 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Volume 6cec1492-9891-4d25-bddd-a36d57f43dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cec1492-9891-4d25-bddd-a36d57f43dcf', 'volume_size': 1} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-120334264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cec1492-9891-4d25-bddd-a36d57f43dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:25Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Creating volume 6cec1492-9891-4d25-bddd-a36d57f43dcf {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:24 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:15:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:24 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf 1073741824 Aug 26 00:15:24 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:25 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf 1073741824" returned: 0 in 0.725s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:25 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf Aug 26 00:15:25 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-20976f16-00b9-4e37-9e10-09d413d8fffe tempest-GroupsV320Test-623862419 None] Group tempest-GroupsV320Test-Group-1617535614: creating Aug 26 00:15:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-20976f16-00b9-4e37-9e10-09d413d8fffe tempest-GroupsV320Test-623862419 None] Group tempest-GroupsV320Test-Group-1617535614: created successfully Aug 26 00:15:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-20976f16-00b9-4e37-9e10-09d413d8fffe tempest-GroupsV320Test-623862419 None] Create group completed successfully. Aug 26 00:15:25 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f5f34a-53b0-463e-9e2b-9c8b7aef6598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cec1492-9891-4d25-bddd-a36d57f43dcf', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0277a950-b6c5-4aab-950a-8d1868edf0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Volume volume-6cec1492-9891-4d25-bddd-a36d57f43dcf (6cec1492-9891-4d25-bddd-a36d57f43dcf): created successfully Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0277a950-b6c5-4aab-950a-8d1868edf0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (e8eeaa22-a4e5-47a5-9760-a39ff87f3e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-28faee4d-7f06-46fa-9381-ebf94eb23183 tempest-AttachVolumeTestJSON-1871664473 None] Created volume successfully. Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Created reservations ['bae92c33-feac-4a9e-b7ef-ef3a10e26851'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:27 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:27 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-bc38ab32-0051-46fc-af96-cd11d37b6065 req-ae69046b-dc56-4e15-9f02-2ff158482f1b tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-bc38ab32-0051-46fc-af96-cd11d37b6065 req-ae69046b-dc56-4e15-9f02-2ff158482f1b tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-bc38ab32-0051-46fc-af96-cd11d37b6065 req-ae69046b-dc56-4e15-9f02-2ff158482f1b tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-bc38ab32-0051-46fc-af96-cd11d37b6065 req-ae69046b-dc56-4e15-9f02-2ff158482f1b tempest-AttachVolumeTestJSON-1871664473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-6cec1492-9891-4d25-bddd-a36d57f43dcf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51b61cbf-f46c-4335-9395-b46a96eda3f3', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:15:27 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-bc38ab32-0051-46fc-af96-cd11d37b6065 req-ae69046b-dc56-4e15-9f02-2ff158482f1b tempest-AttachVolumeTestJSON-1871664473 None] attachment_update completed successfully. Aug 26 00:15:27 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.294s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:27 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:27 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e0435118-5384-4300-acea-926fa9f27891 tempest-GroupsV320Test-623862419 None] Delete group completed successfully. Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (237d9a74-ae1a-43a8-864c-aef139da8cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa93b95b-08e0-4fab-b62f-2f41e72787f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa93b95b-08e0-4fab-b62f-2f41e72787f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1859946379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2015e527-fe62-42a4-81eb-a3fb4eaca2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:31Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7014fd7-2ef1-4c28-87bf-c57d245dd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7014fd7-2ef1-4c28-87bf-c57d245dd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b0db10-bcdf-4ecf-9f84-0c4af242ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5b0db10-bcdf-4ecf-9f84-0c4af242ea85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2015e527-fe62-42a4-81eb-a3fb4eaca2c8', 'volume_name': 'volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3dc783-a605-4c91-97f9-68ca38e79824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3dc783-a605-4c91-97f9-68ca38e79824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c6854e-4c6b-43f9-9d76-67698172f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Volume 2015e527-fe62-42a4-81eb-a3fb4eaca2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8', 'volume_size': 1} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1859946379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2015e527-fe62-42a4-81eb-a3fb4eaca2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2115b91b9a504130873a96eadad18759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:31Z,use_quota=True,user_id='bd7073aebc7a4e728770da1878472167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Creating volume 2015e527-fe62-42a4-81eb-a3fb4eaca2c8 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:30 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:15:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:30 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 1073741824 Aug 26 00:15:30 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:31 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 1073741824" returned: 0 in 0.672s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:31 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 Aug 26 00:15:31 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:31 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:15:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65c6854e-4c6b-43f9-9d76-67698172f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e3d90c-07ff-428e-9413-8e666b56f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Volume volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 (2015e527-fe62-42a4-81eb-a3fb4eaca2c8): created successfully Aug 26 00:15:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e3d90c-07ff-428e-9413-8e666b56f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Flow 'volume_create_manager' (237d9a74-ae1a-43a8-864c-aef139da8cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-58704a15-c96d-4be3-992a-44bec7c1861e tempest-AttachVolumeTestJSON-1871664473 None] Created volume successfully. Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c07c7d4e-0aff-46df-b5dc-5b427e3bb04e req-cfcdfa0c-605b-4ee4-b9c4-824d0c8cd79f tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c07c7d4e-0aff-46df-b5dc-5b427e3bb04e req-cfcdfa0c-605b-4ee4-b9c4-824d0c8cd79f tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-c07c7d4e-0aff-46df-b5dc-5b427e3bb04e req-cfcdfa0c-605b-4ee4-b9c4-824d0c8cd79f tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-c07c7d4e-0aff-46df-b5dc-5b427e3bb04e req-cfcdfa0c-605b-4ee4-b9c4-824d0c8cd79f tempest-AttachVolumeTestJSON-1871664473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4fbe986-f731-42ce-898f-eb2988ab45a3', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=84,cinder:SELECT=85,cinder:INSERT=21,cinder:DELETE=8 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:15:33 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=92,cinder:UPDATE=79,cinder:INSERT=25,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:15:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-c07c7d4e-0aff-46df-b5dc-5b427e3bb04e req-cfcdfa0c-605b-4ee4-b9c4-824d0c8cd79f tempest-AttachVolumeTestJSON-1871664473 None] attachment_update completed successfully. Aug 26 00:15:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-4e68d6b8-abb1-496a-891c-d4a86276f868 req-8dade9ea-4c37-4806-aade-1c90f2f782bb tempest-AttachVolumeTestJSON-1871664473 None] Terminate volume connection completed successfully. Aug 26 00:15:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-4e68d6b8-abb1-496a-891c-d4a86276f868 req-8dade9ea-4c37-4806-aade-1c90f2f782bb tempest-AttachVolumeTestJSON-1871664473 None] Deleting attachment 51b61cbf-f46c-4335-9395-b46a96eda3f3. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:15:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-90bed38b-e53d-4caa-a29d-945988b8b56a req-e9fc16e2-6ee4-4be1-9534-7f84d7f27e2a tempest-AttachVolumeTestJSON-1871664473 None] Terminate volume connection completed successfully. Aug 26 00:15:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-90bed38b-e53d-4caa-a29d-945988b8b56a req-e9fc16e2-6ee4-4be1-9534-7f84d7f27e2a tempest-AttachVolumeTestJSON-1871664473 None] Deleting attachment d4fbe986-f731-42ce-898f-eb2988ab45a3. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:15:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-8cdc30b7-8fbb-4d13-a36c-ade2ddd77ee7 req-7fa6421e-3147-42b3-8f11-5fff9d8f9cec tempest-TestShelveInstance-301450603 None] Terminate volume connection completed successfully. Aug 26 00:15:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-8cdc30b7-8fbb-4d13-a36c-ade2ddd77ee7 req-7fa6421e-3147-42b3-8f11-5fff9d8f9cec tempest-TestShelveInstance-301450603 None] Deleting attachment 26df71a6-5c8e-4745-97ca-0e841d9b6628. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:15:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-b3227c8e-e0a8-476d-b514-65758babcae9 req-8732e3f1-4515-4f5e-978d-61f8693de5d8 tempest-TestShelveInstance-301450603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-b3227c8e-e0a8-476d-b514-65758babcae9 req-8732e3f1-4515-4f5e-978d-61f8693de5d8 tempest-TestShelveInstance-301450603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-b3227c8e-e0a8-476d-b514-65758babcae9 req-8732e3f1-4515-4f5e-978d-61f8693de5d8 tempest-TestShelveInstance-301450603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-b3227c8e-e0a8-476d-b514-65758babcae9 req-8732e3f1-4515-4f5e-978d-61f8693de5d8 tempest-TestShelveInstance-301450603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05918249-89bf-4132-86ee-2cf0667a8475', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:15:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-b3227c8e-e0a8-476d-b514-65758babcae9 req-8732e3f1-4515-4f5e-978d-61f8693de5d8 tempest-TestShelveInstance-301450603 None] attachment_update completed successfully. Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-2015e527-fe62-42a4-81eb-a3fb4eaca2c8-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-2015e527-fe62-42a4-81eb-a3fb4eaca2c8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-quobyte-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9558502-1964-48ca-946b-a8755aa3a87f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:46 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 Aug 26 00:15:46 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:46 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:46 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:46 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" returned: 0 in 0.493s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:46 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8 Aug 26 00:15:46 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:46 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.439s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:15:47 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-2015e527-fe62-42a4-81eb-a3fb4eaca2c8" released by "delete_volume" :: held 0.951s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Created reservations ['77fd466e-c91c-4d39-a5b9-23dde7354c1f', '80acad5d-2b0f-4e19-8795-d3e3c2030ba8', 'c103b486-aeeb-4352-ad19-36a4c4fcafd2', 'f0592757-7f4c-40b6-9d65-55599009fd9b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:47 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:47 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:47 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.332s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:47 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Deleted volume successfully. Aug 26 00:15:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128cc946-3624-4468-a2e2-79a0af26357e tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-2015e527-fe62-42a4-81eb-a3fb4eaca2c8-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-6cec1492-9891-4d25-bddd-a36d57f43dcf-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-6cec1492-9891-4d25-bddd-a36d57f43dcf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-quobyte-6cec1492-9891-4d25-bddd-a36d57f43dcf" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-6cec1492-9891-4d25-bddd-a36d57f43dcf" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58648b4-0903-437e-bec8-ce4ca3a0f11c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:48 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf Aug 26 00:15:48 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:49 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf" returned: 0 in 0.729s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:49 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf Aug 26 00:15:49 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:49 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6cec1492-9891-4d25-bddd-a36d57f43dcf" returned: 0 in 0.446s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-6cec1492-9891-4d25-bddd-a36d57f43dcf" released by "delete_volume" :: held 1.237s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Created reservations ['c1ecffe9-6de0-4b92-8f74-0ec68ba7da73', '68a2c433-b752-4db0-81fe-698d5d1e908e', '9cc76c06-86fc-431c-8a93-0980af684caa', 'f5209c58-a6ca-420f-b4ed-8f883d075050'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:50 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:50 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:50 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.301s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:50 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Deleted volume successfully. Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-89eb2367-8cfd-4929-a2d4-a4ece3dcda5c tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-6cec1492-9891-4d25-bddd-a36d57f43dcf-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-c66d969a-b993-4b56-ba9c-14045e6785b2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-c66d969a-b993-4b56-ba9c-14045e6785b2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "cinder-quobyte-c66d969a-b993-4b56-ba9c-14045e6785b2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-c66d969a-b993-4b56-ba9c-14045e6785b2" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc31c76-bc31-422e-b252-044ab260031e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:51 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 Aug 26 00:15:51 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:51 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2" returned: 0 in 0.582s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:51 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2 Aug 26 00:15:51 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:52 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c66d969a-b993-4b56-ba9c-14045e6785b2" returned: 0 in 0.472s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-quobyte-c66d969a-b993-4b56-ba9c-14045e6785b2" released by "delete_volume" :: held 1.145s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Created reservations ['4b160fe8-fcd0-424f-8ec4-40bffe533114', '8fbf8c74-e010-4835-b1d9-0337ae3b2447', '0bd02d84-5da0-4c27-964c-94b4b0a70933', '0ae4279a-c400-4316-b877-ad3ec41eccff'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:52 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:52 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:53 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.389s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Deleted volume successfully. Aug 26 00:15:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90cc5a6e-359c-47a0-b636-6178b29311e5 tempest-AttachVolumeTestJSON-1871664473 None] Lock "cinder-c66d969a-b993-4b56-ba9c-14045e6785b2-delete_volume" released by "delete_volume" :: held 2.081s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Flow 'volume_create_manager' (c6394d2f-2520-4d32-8ecb-a166383aa750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05453b7d-a8ee-4603-9295-884d37a4ab6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05453b7d-a8ee-4603-9295-884d37a4ab6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1493607506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6049f8-d4ef-4159-8416-ee05f63f469c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e3d1e7fe484ecf9397f501e614d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:57Z,use_quota=True,user_id='7fae97ebf4b54d2aac4e3537a1e474a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec18e66c-ef47-4cea-beb1-606763b5045d),volume_type_id=ec18e66c-ef47-4cea-beb1-606763b5045d)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fa01a-191b-40fd-a329-7d8d20055594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4fa01a-191b-40fd-a329-7d8d20055594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13896c16-0455-4815-a5b1-c08ffa3da859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13896c16-0455-4815-a5b1-c08ffa3da859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6049f8-d4ef-4159-8416-ee05f63f469c', 'volume_name': 'volume-dc6049f8-d4ef-4159-8416-ee05f63f469c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8778ed09-3a47-447d-9b20-470e99ffb846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8778ed09-3a47-447d-9b20-470e99ffb846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf86ecc-f81a-44fd-894b-b153d2ec3922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Volume dc6049f8-d4ef-4159-8416-ee05f63f469c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6049f8-d4ef-4159-8416-ee05f63f469c', 'volume_size': 1} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1493607506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6049f8-d4ef-4159-8416-ee05f63f469c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21e3d1e7fe484ecf9397f501e614d91a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:15:57Z,use_quota=True,user_id='7fae97ebf4b54d2aac4e3537a1e474a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec18e66c-ef47-4cea-beb1-606763b5045d),volume_type_id=ec18e66c-ef47-4cea-beb1-606763b5045d)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Creating volume dc6049f8-d4ef-4159-8416-ee05f63f469c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:15:56 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:15:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:57 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c 1073741824 Aug 26 00:15:57 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:57 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c 1073741824" returned: 0 in 0.550s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:57 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c Aug 26 00:15:57 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:57 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c" returned: 0 in 0.297s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf86ecc-f81a-44fd-894b-b153d2ec3922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6049f8-d4ef-4159-8416-ee05f63f469c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1ce7f7-716e-448a-96f3-3b6680b54689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:15:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Volume volume-dc6049f8-d4ef-4159-8416-ee05f63f469c (dc6049f8-d4ef-4159-8416-ee05f63f469c): created successfully Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1ce7f7-716e-448a-96f3-3b6680b54689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:15:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Flow 'volume_create_manager' (c6394d2f-2520-4d32-8ecb-a166383aa750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:15:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b26df436-793e-4cc7-884d-6f3632f05cfc tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Created volume successfully. Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:15:59 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:15:59 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:15:59 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:15:59 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:15:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fb5254cb-fe0c-4e69-b921-19bcc30532c4 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Retype volume completed successfully. Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "cinder-dc6049f8-d4ef-4159-8416-ee05f63f469c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "cinder-dc6049f8-d4ef-4159-8416-ee05f63f469c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "cinder-quobyte-dc6049f8-d4ef-4159-8416-ee05f63f469c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "cinder-quobyte-dc6049f8-d4ef-4159-8416-ee05f63f469c" acquired by "delete_volume" :: waited 0.031s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[002565c3-02dd-4dd8-bbd6-c0d3dedc0611]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:00 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c Aug 26 00:16:00 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:01 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c" returned: 0 in 0.431s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:01 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c Aug 26 00:16:01 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:01 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-dc6049f8-d4ef-4159-8416-ee05f63f469c" returned: 0 in 0.298s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "cinder-quobyte-dc6049f8-d4ef-4159-8416-ee05f63f469c" released by "delete_volume" :: held 0.794s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:01 devstack cinder-volume[94433]: WARNING cinder.quota [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:16:01 devstack cinder-volume[94433]: WARNING cinder.quota [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Created reservations ['8f703cfc-f391-4d61-ae76-e5340a690a11', '0f70fc47-139e-43dd-ac48-6c5d62e0bb07', '3cb0d7bc-e8d6-46a1-9d30-925dccb2115f', 'd84e2106-ed63-44fa-8853-6f5e59d3b020'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:01 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:01 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:02 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.289s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Deleted volume successfully. Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-982102c1-829d-4d7c-adce-66b038a31a17 tempest-VolumeRetypeWithoutMigrationTest-521646238 None] Lock "cinder-dc6049f8-d4ef-4159-8416-ee05f63f469c-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Flow 'volume_create_manager' (e61e38e5-c56e-4810-ab8f-c620a84915ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0ffc15-e91a-4615-8027-4b099376c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da0ffc15-e91a-4615-8027-4b099376c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-377986961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe363128-b9a0-4a84-a237-562f590c6127,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb65ba6aaf0b4d59806391db136f2ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:03Z,use_quota=True,user_id='6d51fee19f534cacb43b8d9a4858f2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfbd8a9-7100-4661-b782-10c932cb3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccfbd8a9-7100-4661-b782-10c932cb3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ab03be-9803-4ff7-8c25-7230a256e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ab03be-9803-4ff7-8c25-7230a256e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe363128-b9a0-4a84-a237-562f590c6127', 'volume_name': 'volume-fe363128-b9a0-4a84-a237-562f590c6127', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3325597c-9dc6-4cd1-840d-f9a2aa45623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3325597c-9dc6-4cd1-840d-f9a2aa45623a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2709e2a5-6feb-4a23-b34c-28492eec2940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Volume fe363128-b9a0-4a84-a237-562f590c6127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe363128-b9a0-4a84-a237-562f590c6127', 'volume_size': 1} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-377986961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe363128-b9a0-4a84-a237-562f590c6127,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eb65ba6aaf0b4d59806391db136f2ef9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:03Z,use_quota=True,user_id='6d51fee19f534cacb43b8d9a4858f2d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Creating volume fe363128-b9a0-4a84-a237-562f590c6127 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:16:02 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:16:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:03 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 1073741824 Aug 26 00:16:03 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:03 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 1073741824" returned: 0 in 0.551s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:03 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 Aug 26 00:16:03 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:03 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2709e2a5-6feb-4a23-b34c-28492eec2940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe363128-b9a0-4a84-a237-562f590c6127', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dece5ae5-a178-4800-b1f4-135038c1bf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:03 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Volume volume-fe363128-b9a0-4a84-a237-562f590c6127 (fe363128-b9a0-4a84-a237-562f590c6127): created successfully Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dece5ae5-a178-4800-b1f4-135038c1bf5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Flow 'volume_create_manager' (e61e38e5-c56e-4810-ab8f-c620a84915ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-abccaf44-00a7-441c-b658-d777bf8ece77 req-34f46c72-77f4-4252-9098-8a1b8cbbe508 tempest-VolumesGetTestJSON-1915051794 None] Created volume successfully. Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Acquiring lock "cinder-fe363128-b9a0-4a84-a237-562f590c6127-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "cinder-fe363128-b9a0-4a84-a237-562f590c6127-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Acquiring lock "cinder-quobyte-fe363128-b9a0-4a84-a237-562f590c6127" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "cinder-quobyte-fe363128-b9a0-4a84-a237-562f590c6127" acquired by "delete_volume" :: waited 0.049s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a3206-40c0-4249-a635-16031fac2091]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:05 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 Aug 26 00:16:05 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:06 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127" returned: 0 in 0.437s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:06 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127 Aug 26 00:16:06 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:06 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe363128-b9a0-4a84-a237-562f590c6127" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "cinder-quobyte-fe363128-b9a0-4a84-a237-562f590c6127" released by "delete_volume" :: held 0.798s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG cinder.quota [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Created reservations ['cf8d49b1-36ca-419d-934d-81461647c24d', '33afecab-a9b5-4d12-b515-1c09bd7b6ae1', '3a128f58-3a66-4d1d-95df-0e9539950cea', 'd3ac6a14-029b-4cb0-9536-f68d9ad1ae07'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:06 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:06 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:07 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.357s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:07 devstack cinder-volume[94433]: DEBUG cinder.manager [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Deleted volume successfully. Aug 26 00:16:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-418321aa-2cdc-4335-b85d-43912af0bce5 req-39feee69-2c19-4eae-843b-bb123d5dabcf tempest-VolumesGetTestJSON-1915051794 None] Lock "cinder-fe363128-b9a0-4a84-a237-562f590c6127-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-4639e6a5-872e-4abb-82c7-55840bac6b00 req-b7e1cfe0-c24e-4b90-9efb-39e9ef0d4678 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-4639e6a5-872e-4abb-82c7-55840bac6b00 req-b7e1cfe0-c24e-4b90-9efb-39e9ef0d4678 tempest-TestStampPattern-397745456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-4639e6a5-872e-4abb-82c7-55840bac6b00 req-b7e1cfe0-c24e-4b90-9efb-39e9ef0d4678 tempest-TestStampPattern-397745456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-4639e6a5-872e-4abb-82c7-55840bac6b00 req-b7e1cfe0-c24e-4b90-9efb-39e9ef0d4678 tempest-TestStampPattern-397745456 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-6064bd74-5025-4948-adbc-1cee9c9e51ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4772dad-e783-42d0-bb3a-a84e5dae2bac', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:16:08 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-4639e6a5-872e-4abb-82c7-55840bac6b00 req-b7e1cfe0-c24e-4b90-9efb-39e9ef0d4678 tempest-TestStampPattern-397745456 None] attachment_update completed successfully. Aug 26 00:16:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f4aaaf7-38f6-4207-81ca-15a95b5f01ba tempest-GroupSnapshotsV319Test-1078215090 None] Group tempest-GroupSnapshotsV319Test-Group-1007741297: creating Aug 26 00:16:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f4aaaf7-38f6-4207-81ca-15a95b5f01ba tempest-GroupSnapshotsV319Test-1078215090 None] Group tempest-GroupSnapshotsV319Test-Group-1007741297: created successfully Aug 26 00:16:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5f4aaaf7-38f6-4207-81ca-15a95b5f01ba tempest-GroupSnapshotsV319Test-1078215090 None] Create group completed successfully. Aug 26 00:16:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-16f2e02a-0e88-410d-877d-92c030fcdec9 req-653f119f-4265-4576-a032-486282e266b1 tempest-TestStampPattern-397745456 None] Terminate volume connection completed successfully. Aug 26 00:16:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-16f2e02a-0e88-410d-877d-92c030fcdec9 req-653f119f-4265-4576-a032-486282e266b1 tempest-TestStampPattern-397745456 None] Deleting attachment f4772dad-e783-42d0-bb3a-a84e5dae2bac. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Flow 'volume_create_manager' (2a7648d7-1a8c-4b79-9c93-409d0c7b9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc769b1-8362-4247-903f-7280aced1b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc769b1-8362-4247-903f-7280aced1b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65763051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b4fd86c-cbdf-4969-98ea-4aadc45ff5aa,host='devstack@QuobyteHD#QuobyteHD',id=07f9e022-005f-4751-8b24-beb05e50b4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bc9b78bd4c4a7ba8128400b9063f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:14Z,use_quota=True,user_id='1541fc55c30349cb9f3c521b1dd1d76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(754dc759-b39a-46e8-89b5-4efcb5510315),volume_type_id=754dc759-b39a-46e8-89b5-4efcb5510315)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829754d7-4738-4210-b61d-28578cbc5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (829754d7-4738-4210-b61d-28578cbc5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26ffff-55d7-454b-8ade-e3ade32afbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea26ffff-55d7-454b-8ade-e3ade32afbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f9e022-005f-4751-8b24-beb05e50b4e2', 'volume_name': 'volume-07f9e022-005f-4751-8b24-beb05e50b4e2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a15d9-166d-493b-8635-bfc1d2e7352e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0a15d9-166d-493b-8635-bfc1d2e7352e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ab58cd-7554-4627-89fa-c7a245c0e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Volume 07f9e022-005f-4751-8b24-beb05e50b4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f9e022-005f-4751-8b24-beb05e50b4e2', 'volume_size': 1} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b4fd86c-cbdf-4969-98ea-4aadc45ff5aa,created_at=2026-08-25T22:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65763051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b4fd86c-cbdf-4969-98ea-4aadc45ff5aa,host='devstack@QuobyteHD#QuobyteHD',id=07f9e022-005f-4751-8b24-beb05e50b4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28bc9b78bd4c4a7ba8128400b9063f81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:14Z,use_quota=True,user_id='1541fc55c30349cb9f3c521b1dd1d76d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(754dc759-b39a-46e8-89b5-4efcb5510315),volume_type_id=754dc759-b39a-46e8-89b5-4efcb5510315)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Creating volume 07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:16:14 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:16:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:14 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 1073741824 Aug 26 00:16:14 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:15 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 1073741824" returned: 0 in 0.863s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:15 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 Aug 26 00:16:15 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:15 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2" returned: 0 in 0.455s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ab58cd-7554-4627-89fa-c7a245c0e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f9e022-005f-4751-8b24-beb05e50b4e2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db46d60c-bf02-4437-af05-af2da0c581ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:15 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Volume volume-07f9e022-005f-4751-8b24-beb05e50b4e2 (07f9e022-005f-4751-8b24-beb05e50b4e2): created successfully Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db46d60c-bf02-4437-af05-af2da0c581ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Flow 'volume_create_manager' (2a7648d7-1a8c-4b79-9c93-409d0c7b9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-29d59f0c-3cee-4aee-b051-0e2b49dbb52e tempest-GroupSnapshotsV319Test-1078215090 None] Created volume successfully. Aug 26 00:16:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] GroupSnapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: creating. Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Group snapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: creating. {{(pid=94433) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Creating offline snapshot ff34a598-6e43-4a03-82ab-3de21978d182 of volume 07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e980900-dfcf-4310-965c-6af7ade588f7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:17 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 Aug 26 00:16:17 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-6064bd74-5025-4948-adbc-1cee9c9e51ee-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "cinder-6064bd74-5025-4948-adbc-1cee9c9e51ee-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c07338c-591e-4b42-85f8-8d43001ea9db]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:17 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2" returned: 0 in 0.455s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:17 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 1G Aug 26 00:16:17 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:17 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee Aug 26 00:16:17 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:18 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee" returned: 0 in 0.466s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:18 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee Aug 26 00:16:18 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:18 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 1G" returned: 0 in 0.515s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07f9e022-005f-4751-8b24-beb05e50b4e2 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:18 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07f9e022-005f-4751-8b24-beb05e50b4e2 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 Aug 26 00:16:18 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:18 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6064bd74-5025-4948-adbc-1cee9c9e51ee" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-6064bd74-5025-4948-adbc-1cee9c9e51ee" released by "delete_volume" :: held 0.780s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Created reservations ['6596c968-bec7-4ef6-a9a2-0ac323986b58', '7aef83e7-64ef-4b0d-8f95-981a67a89530', '122ea10e-69b2-436c-956d-d3bbfeb0cf65', '2dde3c44-af37-4d3c-890b-693fa5965c52'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:18 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07f9e022-005f-4751-8b24-beb05e50b4e2 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182" returned: 0 in 0.338s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:18 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:18 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:18 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 Aug 26 00:16:18 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:18 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:18 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Deleted volume successfully. Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e19c7f47-5a34-4368-970c-7f142c5ec326 tempest-TestStampPattern-397745456 None] Lock "cinder-6064bd74-5025-4948-adbc-1cee9c9e51ee-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:18 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info Aug 26 00:16:18 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-e67e61a5-a5a3-432a-a366-40f903a477ed-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-e67e61a5-a5a3-432a-a366-40f903a477ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Deleting offline snapshot e67e61a5-a5a3-432a-a366-40f903a477ed of volume 178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] snapshot_file for this snap is: volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[51295d5b-70ca-471e-b2bc-c2345a339f08]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:19 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info" returned: 0 in 0.475s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:19 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:19 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:16:19 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:19 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info Aug 26 00:16:19 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:19 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.info" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:19 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.527s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.441s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-178bc069-758d-48e5-b02f-0f3c9180926f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[907ee57d-f7b0-40d7-9257-039c6caecf6b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8602e08f-ad78-4b7d-b3b3-0c2e04757b77 tempest-GroupSnapshotsV319Test-1078215090 None] group_snapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: created successfully Aug 26 00:16:19 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:16:19 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:20 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.528s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:20 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:16:20 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:20 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.413s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:20 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed Aug 26 00:16:20 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:20 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] group_snapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: deleting Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] group_snapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: deleting {{(pid=94433) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "cinder-quobyte-ff34a598-6e43-4a03-82ab-3de21978d182" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-ff34a598-6e43-4a03-82ab-3de21978d182" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Deleting offline snapshot ff34a598-6e43-4a03-82ab-3de21978d182 of volume 07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] snapshot_file for this snap is: volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f1163c-a7c7-4d07-8da8-239a21ee8433]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:20 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f.e67e61a5-a5a3-432a-a366-40f903a477ed" returned: 0 in 0.333s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:21 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 Aug 26 00:16:21 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-e67e61a5-a5a3-432a-a366-40f903a477ed" released by "_delete_snapshot" :: held 1.853s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" released by "delete_snapshot" :: held 1.877s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Created reservations ['0068e723-1185-4b5a-84a8-b1110596c2e7', '297a12bd-6f08-44cb-8542-529852218ee6', '0f5bb512-8f8d-4188-9185-72da4e49cb3c', 'e9bbed1c-307a-4e39-8883-f3beb443aa33'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Delete snapshot completed successfully. Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1eb1f79d-f13b-4372-908a-4d7f4c9923bf tempest-TestStampPattern-397745456 None] Lock "cinder-e67e61a5-a5a3-432a-a366-40f903a477ed-delete_snapshot" released by "delete_snapshot" :: held 2.066s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:21 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182" returned: 0 in 0.466s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07f9e022-005f-4751-8b24-beb05e50b4e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d8fd1-8131-488a-9dab-e70605696503]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:21 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 Aug 26 00:16:21 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:21 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2" returned: 0 in 0.468s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:21 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 Aug 26 00:16:21 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:22 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182" returned: 0 in 0.487s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:22 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182 Aug 26 00:16:22 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:22 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2.ff34a598-6e43-4a03-82ab-3de21978d182" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-ff34a598-6e43-4a03-82ab-3de21978d182" released by "_delete_snapshot" :: held 1.967s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" released by "delete_snapshot" :: held 2.005s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:22 devstack cinder-volume[94433]: WARNING cinder.quota [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1974205884 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1974205884, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:16:22 devstack cinder-volume[94433]: WARNING cinder.quota [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1974205884 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1974205884, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:16:22 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] Created reservations ['643a9b50-470f-4c4c-bdf6-d2e994a64303', '11171284-3721-4395-a918-721edbf4c06c', '1bf9c9e9-d995-4aa3-92da-512ad86c011e', '0926abfb-bd2f-45eb-af18-e520ab23faa3'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-cce04f90-071f-408e-9a22-8f008f054b7d tempest-GroupSnapshotsV319Test-1078215090 None] group_snapshot 6aee5a97-9b1e-4b9e-8a35-51dcb0b2994a: deleted successfully Aug 26 00:16:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[823b8ecd-877e-4122-a7de-77185099fbf0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:23 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 Aug 26 00:16:23 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:24 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2" returned: 0 in 0.451s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:24 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2 Aug 26 00:16:24 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:24 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-07f9e022-005f-4751-8b24-beb05e50b4e2" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "cinder-quobyte-07f9e022-005f-4751-8b24-beb05e50b4e2" released by "delete_volume" :: held 0.811s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Created reservations ['1ab666d8-2033-462d-b861-dab644ec914b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:24 devstack cinder-volume[94433]: WARNING cinder.quota [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1974205884 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1974205884, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Created reservations ['bf764849-0bf3-4261-be09-875ccfef975c', '6a5ba559-957c-40ac-8a96-849feca0a6cf', 'f34332b3-fd77-4229-8416-06b8ce86ebcd', '430808c0-ccc2-4d19-9345-753b8832a5c4'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:24 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:24 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:25 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.510s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:25 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0090a09b-c361-426b-9c8a-803c7b3e8684 tempest-GroupSnapshotsV319Test-1078215090 None] Delete group completed successfully. Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-178bc069-758d-48e5-b02f-0f3c9180926f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "cinder-178bc069-758d-48e5-b02f-0f3c9180926f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Acquiring lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[974404d0-ff04-4633-b936-8c7c3fc35757]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:26 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:16:26 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:26 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.439s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:26 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f Aug 26 00:16:26 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:26 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-178bc069-758d-48e5-b02f-0f3c9180926f" returned: 0 in 0.298s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "cinder-quobyte-178bc069-758d-48e5-b02f-0f3c9180926f" released by "delete_volume" :: held 0.831s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Created reservations ['a89d9462-6da9-40ae-a42b-895f2a1c5229', '879d72b2-ac82-4694-b191-a21ed9acd132', 'ae92c38e-0749-4917-98de-39b5cdf8e3bf', '2f00437b-94be-4d09-a912-f1e3fbb6fddb'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:27 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:27 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:27 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.416s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:27 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Deleted volume successfully. Aug 26 00:16:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ed69ba0-a4db-451c-9a53-e47d1dc46d3f tempest-TestStampPattern-397745456 None] Lock "cinder-178bc069-758d-48e5-b02f-0f3c9180926f-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=107,cinder:SELECT=94,cinder:INSERT=25,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=98,cinder:UPDATE=90,cinder:INSERT=20,cinder:DELETE=4 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:16:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-1f83c03f-2864-49c0-b93d-04a1d33fee66 tempest-TestShelveInstance-301450603 None] Terminate volume connection completed successfully. Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-1f83c03f-2864-49c0-b93d-04a1d33fee66 tempest-TestShelveInstance-301450603 None] Deleting attachment 05918249-89bf-4132-86ee-2cf0667a8475. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Acquiring lock "cinder-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "cinder-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Acquiring lock "cinder-quobyte-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "cinder-quobyte-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbed2e1-2c5a-48cc-992c-0353d00d1d06]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:35 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 Aug 26 00:16:35 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:35 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" returned: 0 in 0.476s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:35 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95 Aug 26 00:16:35 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:35 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" returned: 0 in 0.309s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "cinder-quobyte-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95" released by "delete_volume" :: held 0.865s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG cinder.quota [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Created reservations ['bc71cbe8-8037-4442-bb84-5a22744fff08', '166f371e-7ec5-4c76-ab90-db1e44d8dec8', '8180f085-bd0e-44d7-9313-7534ec2e55c4', '07997789-587b-4194-b98f-b1d625b62edb'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:35 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:35 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:36 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.289s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:36 devstack cinder-volume[94433]: DEBUG cinder.manager [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Deleted volume successfully. Aug 26 00:16:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [req-9ee67e69-2eac-406f-96e7-e6f367b36911 req-25855b11-586d-42be-ab7d-9b7760862dc7 tempest-TestShelveInstance-301450603 None] Lock "cinder-01ffa4fa-bd02-40ba-9d4c-21f20e51ae95-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:46 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:46 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:47 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.476s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:16:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:16:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Flow 'volume_create_manager' (ceabfd1b-3ead-4181-a7c7-a9bdbf4bc3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ba0dc7-c531-4d43-94aa-5954c63f8266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ba0dc7-c531-4d43-94aa-5954c63f8266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1566183642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411c7a90-b1e5-4523-8f15-f1f1aaf28ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e96f904d454ab1892d976c04346c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:52Z,use_quota=True,user_id='a7577d5db51744758a9d628bb5cd321d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a7258a-d669-4207-95e6-ef5972b3560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a7258a-d669-4207-95e6-ef5972b3560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10aa072-f514-4098-8d91-17f46bd4a3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10aa072-f514-4098-8d91-17f46bd4a3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '411c7a90-b1e5-4523-8f15-f1f1aaf28ee7', 'volume_name': 'volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232eabce-86b2-4886-a4ea-bdedcdf689c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232eabce-86b2-4886-a4ea-bdedcdf689c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966c2422-e294-4fd9-b0e3-b3999d227b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Volume 411c7a90-b1e5-4523-8f15-f1f1aaf28ee7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7', 'volume_size': 1} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1566183642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=411c7a90-b1e5-4523-8f15-f1f1aaf28ee7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85e96f904d454ab1892d976c04346c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:52Z,use_quota=True,user_id='a7577d5db51744758a9d628bb5cd321d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Creating volume 411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:16:52 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:52 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 1073741824 Aug 26 00:16:52 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:52 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 1073741824" returned: 0 in 0.629s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:52 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 Aug 26 00:16:52 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:53 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" returned: 0 in 0.462s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966c2422-e294-4fd9-b0e3-b3999d227b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388c0c2a-bf9b-4d0f-906b-6622f76bce52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Volume volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 (411c7a90-b1e5-4523-8f15-f1f1aaf28ee7): created successfully Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (388c0c2a-bf9b-4d0f-906b-6622f76bce52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Flow 'volume_create_manager' (ceabfd1b-3ead-4181-a7c7-a9bdbf4bc3e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-aa4a71b0-b092-4619-9b7c-e619894e19e0 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Created volume successfully. Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Acquiring lock "cinder-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "cinder-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Acquiring lock "cinder-quobyte-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "cinder-quobyte-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c23184d-e5f7-4b70-95b8-30a051068d4e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:16:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:56 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 Aug 26 00:16:56 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:56 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" returned: 0 in 0.726s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:56 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7 Aug 26 00:16:56 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:57 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" returned: 0 in 0.509s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "cinder-quobyte-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7" released by "delete_volume" :: held 1.332s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Created reservations ['fca40e01-61df-4773-b977-f4dad848a618', '77302d6b-8d19-418f-b172-142d1fe389c7', '973b2f6c-5e79-48f3-bd7b-8dbe5008c281', '3b3841e7-ec6b-4f69-ac0f-f84399b636f5'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:57 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:16:57 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:57 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:16:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Deleted volume successfully. Aug 26 00:16:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a8397a60-f7c9-487e-bdd8-d720149af5f6 tempest-VolumeQuotasNegativeTestJSON-469721878 None] Lock "cinder-411c7a90-b1e5-4523-8f15-f1f1aaf28ee7-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (0354ccaf-2980-47d6-b46c-601098300253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a1a38-fa78-42c6-a24a-51a92e67b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9a1a38-fa78-42c6-a24a-51a92e67b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-157937544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f209d69a-d556-4c9e-a991-e9ccf323571a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:59Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc297f0-bdc9-4b5f-9b06-c44213062e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc297f0-bdc9-4b5f-9b06-c44213062e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e204eb5b-ac7a-4146-b52f-edbde730d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e204eb5b-ac7a-4146-b52f-edbde730d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f209d69a-d556-4c9e-a991-e9ccf323571a', 'volume_name': 'volume-f209d69a-d556-4c9e-a991-e9ccf323571a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b78a0c-3de1-40f5-94f5-1463ca53ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b78a0c-3de1-40f5-94f5-1463ca53ff52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426a6bf8-f2ec-48df-8235-53e3952cd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:16:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Volume f209d69a-d556-4c9e-a991-e9ccf323571a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f209d69a-d556-4c9e-a991-e9ccf323571a', 'volume_size': 1} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-157937544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f209d69a-d556-4c9e-a991-e9ccf323571a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:16:59Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Creating volume f209d69a-d556-4c9e-a991-e9ccf323571a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:16:58 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:16:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:58 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a 1073741824 Aug 26 00:16:58 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:16:59 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Aug 26 00:16:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a 1073741824" returned: 0 in 0.839s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:16:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:16:59 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a Aug 26 00:16:59 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:00 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a" returned: 0 in 0.523s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (426a6bf8-f2ec-48df-8235-53e3952cd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f209d69a-d556-4c9e-a991-e9ccf323571a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab4f9fa-247c-4f3a-b55e-ca75ee9d4d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Volume volume-f209d69a-d556-4c9e-a991-e9ccf323571a (f209d69a-d556-4c9e-a991-e9ccf323571a): created successfully Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab4f9fa-247c-4f3a-b55e-ca75ee9d4d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (0354ccaf-2980-47d6-b46c-601098300253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f8727a9c-2d28-4581-87de-e4f65535c64c tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-094c629e-7470-468a-9b2a-41dec0d6d941 tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a" by "attach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-094c629e-7470-468a-9b2a-41dec0d6d941 tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a" acquired by "attach_volume" :: waited 0.056s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-094c629e-7470-468a-9b2a-41dec0d6d941 tempest-VolumesActionsTest-875578770 None] Attaching volume f209d69a-d556-4c9e-a991-e9ccf323571a to instance 87a609d4-8a5a-47f4-875e-21fdada2d450 at mountpoint /dev/vdb on host None. Aug 26 00:17:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-094c629e-7470-468a-9b2a-41dec0d6d941 tempest-VolumesActionsTest-875578770 None] Attach volume completed successfully. Aug 26 00:17:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-094c629e-7470-468a-9b2a-41dec0d6d941 tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a" released by "attach_volume" :: held 0.267s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Terminate volume connection completed successfully. Aug 26 00:17:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" by "detach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Detaching volume f209d69a-d556-4c9e-a991-e9ccf323571a from instance 87a609d4-8a5a-47f4-875e-21fdada2d450. Aug 26 00:17:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Detach volume completed successfully. Aug 26 00:17:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-139424c5-5a74-4b37-a000-443173226f25 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" released by "detach_volume" :: held 0.145s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fd994022-dc78-44b1-ae0e-c1cb614b5b8b tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" by "detach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fd994022-dc78-44b1-ae0e-c1cb614b5b8b tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fd994022-dc78-44b1-ae0e-c1cb614b5b8b tempest-VolumesActionsTest-875578770 None] Volume detach called, but volume not attached. Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fd994022-dc78-44b1-ae0e-c1cb614b5b8b tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-quobyte-f209d69a-d556-4c9e-a991-e9ccf323571a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "cinder-quobyte-f209d69a-d556-4c9e-a991-e9ccf323571a" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a8362-da12-4281-9f91-ba54c08a393e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:03 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a Aug 26 00:17:03 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:04 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a" returned: 0 in 0.642s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:04 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a Aug 26 00:17:04 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:04 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f209d69a-d556-4c9e-a991-e9ccf323571a" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "cinder-quobyte-f209d69a-d556-4c9e-a991-e9ccf323571a" released by "delete_volume" :: held 1.224s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Created reservations ['ee235409-a0c8-48d6-9144-e28b4c611564', 'dc346c5e-e8f9-4fc9-adb9-b79430dd12de', '336dce92-adce-46b7-b23c-3747adbb497e', '912f02ae-abf7-43ff-8889-d8d88bfbef31'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:05 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:05 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:05 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:05 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Deleted volume successfully. Aug 26 00:17:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6fb4bbd5-c5d4-4aef-9866-f7bda9e90b97 tempest-VolumesActionsTest-875578770 None] Lock "cinder-f209d69a-d556-4c9e-a991-e9ccf323571a-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Flow 'volume_create_manager' (c9358365-94e3-4485-86c8-079393f4b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1076b239-e59d-4ac8-90ee-11165dfe787b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1076b239-e59d-4ac8-90ee-11165dfe787b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-746080795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a01460-b5e5-44a4-9785-3c5c58adc271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4134a5b8d460da2b5f450a2428fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:09Z,use_quota=True,user_id='f6945af5b26040ff9a3cb5f68defc2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7377090-92e5-4b9c-a178-8ad9f53ce0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7377090-92e5-4b9c-a178-8ad9f53ce0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd662dc-2efc-446d-a714-e59a1852ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd662dc-2efc-446d-a714-e59a1852ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a01460-b5e5-44a4-9785-3c5c58adc271', 'volume_name': 'volume-67a01460-b5e5-44a4-9785-3c5c58adc271', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1abdda-4d44-4547-b1cd-fe9b3f98e688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1abdda-4d44-4547-b1cd-fe9b3f98e688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67c5b7-0a18-4a1c-aea3-1c94e9a8a2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Volume 67a01460-b5e5-44a4-9785-3c5c58adc271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a01460-b5e5-44a4-9785-3c5c58adc271', 'volume_size': 1} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-746080795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a01460-b5e5-44a4-9785-3c5c58adc271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee4134a5b8d460da2b5f450a2428fd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:09Z,use_quota=True,user_id='f6945af5b26040ff9a3cb5f68defc2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Creating volume 67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:09 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:09 devstack sudo[108522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 1073741824 Aug 26 00:17:09 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Flow 'volume_create_manager' (130aa3c2-5902-46a1-a1d6-61d1f4101a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2f47fe-c878-4d72-9475-42a100616641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2f47fe-c878-4d72-9475-42a100616641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d9b29-3a98-4d1c-999d-38288003e1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af423360b70a417ab91c6f2efbbf845b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:09Z,use_quota=True,user_id='8337cd94e05843158d8caad422550548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8fae0f-d82b-400f-8366-31829c8d87a1),volume_type_id=df8fae0f-d82b-400f-8366-31829c8d87a1)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec04c935-ab7d-4023-b44c-5a6fb617a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec04c935-ab7d-4023-b44c-5a6fb617a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd866022-9d79-4d30-863a-0236ff23223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd866022-9d79-4d30-863a-0236ff23223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '240d9b29-3a98-4d1c-999d-38288003e1b2', 'volume_name': 'volume-240d9b29-3a98-4d1c-999d-38288003e1b2', 'volume_size': 1, 'image_id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb28c5215143f9297b934367fd3714be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af423360b70a417ab91c6f2efbbf845b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '641150094fceededd54015d576465c76267fab757a5c2c32a4944ed4a1ba3ac1182768f57d79fe6845658d02068533455fc47fd101c02ff95ba55d625bb9d48b', 'id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'created_at': datetime.datetime(2026, 8, 25, 22, 17, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc11cb13-279c-46dd-8d3c-87322ff78c40/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7262100-5d2e-492b-995e-4de0f1e53fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7262100-5d2e-492b-995e-4de0f1e53fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad234c9e-e854-4e85-8a75-8602b2711f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Volume 240d9b29-3a98-4d1c-999d-38288003e1b2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-240d9b29-3a98-4d1c-999d-38288003e1b2', 'volume_size': 1, 'image_id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb28c5215143f9297b934367fd3714be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af423360b70a417ab91c6f2efbbf845b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '641150094fceededd54015d576465c76267fab757a5c2c32a4944ed4a1ba3ac1182768f57d79fe6845658d02068533455fc47fd101c02ff95ba55d625bb9d48b', 'id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'created_at': datetime.datetime(2026, 8, 25, 22, 17, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc11cb13-279c-46dd-8d3c-87322ff78c40/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 00:17:09 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Trying to clone 240d9b29-3a98-4d1c-999d-38288003e1b2 from image fc11cb13-279c-46dd-8d3c-87322ff78c40 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:17:10 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 1073741824" returned: 0 in 0.714s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:17:10 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Image download 0.00 MB at 0.00 MB/s Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:10 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 Aug 26 00:17:10 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c969a8-4de2-47bf-8180-10b848ba792b]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:10 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:10 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:10 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271" returned: 0 in 0.430s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f67c5b7-0a18-4a1c-aea3-1c94e9a8a2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a01460-b5e5-44a4-9785-3c5c58adc271', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d630e89a-60cc-415a-aa99-ca4e6a168e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (e9b074e1-fd4a-4471-8b77-c37b11e3fd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa611690-eb40-44f0-b6a3-4ab377d90903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Volume volume-67a01460-b5e5-44a4-9785-3c5c58adc271 (67a01460-b5e5-44a4-9785-3c5c58adc271): created successfully Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d630e89a-60cc-415a-aa99-ca4e6a168e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Flow 'volume_create_manager' (c9358365-94e3-4485-86c8-079393f4b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa611690-eb40-44f0-b6a3-4ab377d90903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-381262046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed7782d-055b-4f20-8168-07c0de4992f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:11Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a12d5a-5530-421c-9cd5-bd68f39190b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a12d5a-5530-421c-9cd5-bd68f39190b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae20362-dbf0-4f4e-8d3c-f871eb943f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae20362-dbf0-4f4e-8d3c-f871eb943f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed7782d-055b-4f20-8168-07c0de4992f7', 'volume_name': 'volume-eed7782d-055b-4f20-8168-07c0de4992f7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded99675-8ff3-4b0f-8c2e-3a86699172e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ded99675-8ff3-4b0f-8c2e-3a86699172e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a05168-e12e-4382-9de7-6c326be45ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Volume eed7782d-055b-4f20-8168-07c0de4992f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed7782d-055b-4f20-8168-07c0de4992f7', 'volume_size': 1} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-381262046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed7782d-055b-4f20-8168-07c0de4992f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:11Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Creating volume eed7782d-055b-4f20-8168-07c0de4992f7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:10 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-29acf476-2787-4683-932e-8015d9832ba1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Created volume successfully. Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 0 in 0.572s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:10 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 1073741824 Aug 26 00:17:10 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:10 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:10 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:11 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Temporary image fc11cb13-279c-46dd-8d3c-87322ff78c40 is fetched for user 8337cd94e05843158d8caad422550548. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef89467-a025-49ae-a427-69759dec01fd]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:11 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 1073741824" returned: 0 in 0.692s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:11 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:11 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:11 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 Aug 26 00:17:11 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:11 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:11 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.275s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a05168-e12e-4382-9de7-6c326be45ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed7782d-055b-4f20-8168-07c0de4992f7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce3be51-4645-473a-9123-b9add50d9e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Creating offline snapshot 2baec11d-19ed-47f4-8cae-c37894438229 of volume 67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:17:12 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Volume volume-eed7782d-055b-4f20-8168-07c0de4992f7 (eed7782d-055b-4f20-8168-07c0de4992f7): created successfully Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce3be51-4645-473a-9123-b9add50d9e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (e9b074e1-fd4a-4471-8b77-c37b11e3fd96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd379f72-da32-41ed-8581-c8013e4267d6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:12 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:12 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-00bc666a-5c20-4735-a3fc-ca6b528fa220 tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:12 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 Aug 26 00:17:12 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:12 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 1 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:12 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271" returned: 0 in 0.418s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:12 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 1G Aug 26 00:17:12 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-eed7782d-055b-4f20-8168-07c0de4992f7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "cinder-eed7782d-055b-4f20-8168-07c0de4992f7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-quobyte-eed7782d-055b-4f20-8168-07c0de4992f7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:13 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 1G" returned: 0 in 0.551s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a01460-b5e5-44a4-9785-3c5c58adc271 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-eed7782d-055b-4f20-8168-07c0de4992f7" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:13 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a01460-b5e5-44a4-9785-3c5c58adc271 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 Aug 26 00:17:13 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e19b7-96d9-44c7-af6e-35293b6eb068]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:13 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 Aug 26 00:17:13 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:13 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67a01460-b5e5-44a4-9785-3c5c58adc271 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229" returned: 0 in 0.335s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:13 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 is being set with open permissions: ugo+rw Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:13 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 Aug 26 00:17:13 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:13 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:13 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7 Aug 26 00:17:13 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:13 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229" returned: 0 in 0.299s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:13 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info Aug 26 00:17:13 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:13 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-eed7782d-055b-4f20-8168-07c0de4992f7" returned: 0 in 0.386s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-eed7782d-055b-4f20-8168-07c0de4992f7" released by "delete_volume" :: held 0.886s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Created reservations ['9c49fe98-6945-4a0e-a6b8-af00f227cf32', 'dc533e67-a1cb-4f84-920a-e1107b8a06af', '98cfc72e-c9bc-406c-88b7-d20043078c81', '940d82d3-42f0-4de7-a141-b81ee174762e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:14 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info" returned: 0 in 0.386s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:14 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info is being set with open permissions: ugo+rw Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:14 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info Aug 26 00:17:14 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:14 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:14 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:14 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.info" returned: 0 in 0.474s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.625s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:14 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240d9b29-3a98-4d1c-999d-38288003e1b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af423360b70a417ab91c6f2efbbf845b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:09Z,use_quota=True,user_id='8337cd94e05843158d8caad422550548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df8fae0f-d82b-400f-8366-31829c8d87a1),volume_type_id=df8fae0f-d82b-400f-8366-31829c8d87a1)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Creating volume 240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:14 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.488s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Deleted volume successfully. Aug 26 00:17:14 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1073741824 Aug 26 00:17:14 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e6c74ecc-797b-41ad-b7e2-81452db46a8a tempest-VolumesActionsTest-1963746977 None] Lock "cinder-eed7782d-055b-4f20-8168-07c0de4992f7-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ccfc0dd0-b820-4a70-b983-02eded963152 tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Create snapshot completed successfully Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (02b015df-45d7-41df-904c-99a280117bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d947642-67ce-4ad3-9c5b-1303004862a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d947642-67ce-4ad3-9c5b-1303004862a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1628524151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0a0e3b-4ef7-4c0a-b528-49e026e7de47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:15Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd206fa-d093-4aaa-962b-20cf5a557ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fd206fa-d093-4aaa-962b-20cf5a557ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dfaf8b-cd60-46b6-bb2e-fe3df5d29712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19dfaf8b-cd60-46b6-bb2e-fe3df5d29712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c0a0e3b-4ef7-4c0a-b528-49e026e7de47', 'volume_name': 'volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27dc42b-b71b-4df3-81cb-7d6ef6492557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d27dc42b-b71b-4df3-81cb-7d6ef6492557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9383d7-af03-40e2-b1e4-3fe6e7e9575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:15 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Volume 1c0a0e3b-4ef7-4c0a-b528-49e026e7de47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47', 'volume_size': 1} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:15 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1073741824" returned: 0 in 0.750s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:15 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 Aug 26 00:17:15 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "cinder-2baec11d-19ed-47f4-8cae-c37894438229-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-2baec11d-19ed-47f4-8cae-c37894438229-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:15 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "cinder-quobyte-2baec11d-19ed-47f4-8cae-c37894438229" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1628524151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c0a0e3b-4ef7-4c0a-b528-49e026e7de47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:15Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Creating volume 1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:15 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-2baec11d-19ed-47f4-8cae-c37894438229" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Deleting offline snapshot 2baec11d-19ed-47f4-8cae-c37894438229 of volume 67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:17:15 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 1073741824 Aug 26 00:17:15 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] snapshot_file for this snap is: volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2875c0e-4c19-4330-b0b1-e911633c6616]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Attempting download of fc11cb13-279c-46dd-8d3c-87322ff78c40 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}])) to volume 240d9b29-3a98-4d1c-999d-38288003e1b2. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d5d9b-9d48-4fe6-946c-3e220a2e4ae1]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 Aug 26 00:17:16 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv Aug 26 00:17:16 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67a01460-b5e5-44a4-9785-3c5c58adc271(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:17:16 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 1073741824" returned: 0 in 0.621s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[348422a0-6a3b-40d0-900c-18c0549b6fc9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 Aug 26 00:17:16 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv Aug 26 00:17:16 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 Aug 26 00:17:16 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:16 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271" returned: 0 in 0.444s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d9383d7-af03-40e2-b1e4-3fe6e7e9575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57c5d3b-ef68-4891-8ee8-b16bd77067c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:16 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:16 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv" returned: 1 in 0.509s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fc11cb13-279c-46dd-8d3c-87322ff78c40__dqgkxzv' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:17:16 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[538a62a2-e3c7-4181-a2b7-0a0939ebc010]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:16 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Volume volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 (1c0a0e3b-4ef7-4c0a-b528-49e026e7de47): created successfully Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57c5d3b-ef68-4891-8ee8-b16bd77067c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:16 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (02b015df-45d7-41df-904c-99a280117bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c97b26f5-7026-4d38-92f2-0ec26ecf0e3b tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:17 devstack sudo[108634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:17 devstack sudo[108634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:17 devstack sudo[108634]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:17 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:17 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229 Aug 26 00:17:17 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:17 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD Aug 26 00:17:17 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-quobyte-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15be80f-b55c-4b4a-831a-3a0f1e4971c7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:17 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] fc11cb13-279c-46dd-8d3c-87322ff78c40 was raw, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:17 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271.2baec11d-19ed-47f4-8cae-c37894438229" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:17 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 Aug 26 00:17:17 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:17 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 Aug 26 00:17:17 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-2baec11d-19ed-47f4-8cae-c37894438229" released by "_delete_snapshot" :: held 2.002s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" released by "delete_snapshot" :: held 2.066s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:17 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Created reservations ['eb2d8ba3-a7b6-4acb-b2e5-8dad0a3cbacb', 'eb08b8b2-f54d-435c-a30c-2f865ec53e8d', '68dd29ad-1b90-4210-93cb-8b8953465c29', '6d992b54-7ea8-4e27-a970-69362fab3fcc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Delete snapshot completed successfully. Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9e71d8c5-d95f-418a-b1e1-4f4ab46717aa tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-2baec11d-19ed-47f4-8cae-c37894438229-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:18 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" returned: 0 in 0.466s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:18 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47 Aug 26 00:17:18 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:18 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2" returned: 0 in 0.577s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fc11cb13-279c-46dd-8d3c-87322ff78c40__r7b8dm0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:17:18 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:18 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1G Aug 26 00:17:18 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:18 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47" released by "delete_volume" :: held 0.808s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Created reservations ['dccb585d-24a6-451c-bfe0-89210a4322c7', '47d74e76-1de2-4e5c-bd29-cad669be9f3a', '3997d47e-92ea-4af1-9401-ba7b1ebe251f', '47510dde-9a79-43ef-a33e-7dec72376d23'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:18 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:18 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:18 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 1G" returned: 0 in 0.427s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Downloaded image fc11cb13-279c-46dd-8d3c-87322ff78c40 ((None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}])) to volume 240d9b29-3a98-4d1c-999d-38288003e1b2 successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Temporary image fc11cb13-279c-46dd-8d3c-87322ff78c40 for user 8337cd94e05843158d8caad422550548 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Marking volume 240d9b29-3a98-4d1c-999d-38288003e1b2 as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Copying metadata from image fc11cb13-279c-46dd-8d3c-87322ff78c40 to 240d9b29-3a98-4d1c-999d-38288003e1b2. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Creating volume glance metadata for volume 240d9b29-3a98-4d1c-999d-38288003e1b2 backed by image fc11cb13-279c-46dd-8d3c-87322ff78c40 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cb28c5215143f9297b934367fd3714be', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad234c9e-e854-4e85-8a75-8602b2711f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240d9b29-3a98-4d1c-999d-38288003e1b2', 'volume_size': 1, 'image_id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fc11cb13-279c-46dd-8d3c-87322ff78c40', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cb28c5215143f9297b934367fd3714be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'af423360b70a417ab91c6f2efbbf845b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '641150094fceededd54015d576465c76267fab757a5c2c32a4944ed4a1ba3ac1182768f57d79fe6845658d02068533455fc47fd101c02ff95ba55d625bb9d48b', 'id': 'fc11cb13-279c-46dd-8d3c-87322ff78c40', 'created_at': datetime.datetime(2026, 8, 25, 22, 17, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 17, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fc11cb13-279c-46dd-8d3c-87322ff78c40/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bf8f32-45d5-4e18-8267-3e1adb19a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Volume volume-240d9b29-3a98-4d1c-999d-38288003e1b2 (240d9b29-3a98-4d1c-999d-38288003e1b2): created successfully Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47bf8f32-45d5-4e18-8267-3e1adb19a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Flow 'volume_create_manager' (130aa3c2-5902-46a1-a1d6-61d1f4101a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-52769a58-587d-4db0-bd81-224c529691ea tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Created volume successfully. Aug 26 00:17:18 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.354s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Deleted volume successfully. Aug 26 00:17:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7027eb81-7d88-437a-b79b-2236356505f0 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-1c0a0e3b-4ef7-4c0a-b528-49e026e7de47-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Acquiring lock "cinder-240d9b29-3a98-4d1c-999d-38288003e1b2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "cinder-240d9b29-3a98-4d1c-999d-38288003e1b2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "cinder-67a01460-b5e5-44a4-9785-3c5c58adc271-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Acquiring lock "cinder-quobyte-240d9b29-3a98-4d1c-999d-38288003e1b2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-67a01460-b5e5-44a4-9785-3c5c58adc271-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "cinder-quobyte-240d9b29-3a98-4d1c-999d-38288003e1b2" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d117f3-8689-4d33-bacf-e7dbaaaa32c3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f012d0-564a-4e41-886b-1817ff95d984]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:19 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 Aug 26 00:17:19 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (f9a23d19-62c7-4157-aa0c-7a63bbc528d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba5a31-a87f-4d9a-98e0-c33e8ff2f71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:19 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 Aug 26 00:17:19 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ba5a31-a87f-4d9a-98e0-c33e8ff2f71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393447349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfc406-8570-4689-b6da-adcda61e8feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:19Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdde979-8ebb-4750-ae43-af5f9c769c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afdde979-8ebb-4750-ae43-af5f9c769c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1950c7b-e72f-42aa-a0fa-df00e10156f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1950c7b-e72f-42aa-a0fa-df00e10156f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fadfc406-8570-4689-b6da-adcda61e8feb', 'volume_name': 'volume-fadfc406-8570-4689-b6da-adcda61e8feb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043a6cef-6140-40d2-9a3e-d2953426626b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043a6cef-6140-40d2-9a3e-d2953426626b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ef25ec-1588-4519-9ade-f0c3a3a6a341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Volume fadfc406-8570-4689-b6da-adcda61e8feb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fadfc406-8570-4689-b6da-adcda61e8feb', 'volume_size': 1} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393447349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fadfc406-8570-4689-b6da-adcda61e8feb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:19Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Creating volume fadfc406-8570-4689-b6da-adcda61e8feb {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:19 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:19 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb 1073741824 Aug 26 00:17:19 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:19 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2" returned: 0 in 0.514s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:19 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2 Aug 26 00:17:19 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:19 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271" returned: 0 in 0.585s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:20 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271 Aug 26 00:17:20 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:20 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-240d9b29-3a98-4d1c-999d-38288003e1b2" returned: 0 in 0.387s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "cinder-quobyte-240d9b29-3a98-4d1c-999d-38288003e1b2" released by "delete_volume" :: held 0.981s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:20 devstack cinder-volume[94433]: WARNING cinder.quota [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:17:20 devstack cinder-volume[94433]: WARNING cinder.quota [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Created reservations ['90657c98-7275-4770-9e63-0858b6a5a74e', 'dc9c556c-2a25-4a5a-8a4b-bbe0b1ab7c2a', 'b73916c8-7984-4bd2-ab91-ef8adf78f0c4', 'de7f6405-9dd0-4205-b0d6-cba1d31fa96d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:20 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-67a01460-b5e5-44a4-9785-3c5c58adc271" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:20 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb 1073741824" returned: 0 in 0.770s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-quobyte-67a01460-b5e5-44a4-9785-3c5c58adc271" released by "delete_volume" :: held 1.047s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:20 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:20 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:20 devstack sudo[108697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb Aug 26 00:17:20 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Created reservations ['25c2f49f-112b-4176-bd29-8c60876632ef', '436fa37a-ad4c-4402-b5ae-9da2c8339107', '099883da-1322-4726-9e58-54fd96428090', 'a54bef29-4210-4157-affa-7c6c14f21865'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:20 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:20 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:20 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb" returned: 0 in 0.455s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:21 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ef25ec-1588-4519-9ade-f0c3a3a6a341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fadfc406-8570-4689-b6da-adcda61e8feb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35553c3b-aeb6-449d-845e-4cc13170e6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.512s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Volume volume-fadfc406-8570-4689-b6da-adcda61e8feb (fadfc406-8570-4689-b6da-adcda61e8feb): created successfully Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35553c3b-aeb6-449d-845e-4cc13170e6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (f9a23d19-62c7-4157-aa0c-7a63bbc528d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Deleted volume successfully. Aug 26 00:17:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2609bda3-3ea9-475f-aac2-b8c4e5c7e1cd tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7e54f23a-6f7e-4b1d-94e1-1b4674b505f1 tempest-VolumeAndVolumeTypeFromImageTest-1942461589 None] Lock "cinder-240d9b29-3a98-4d1c-999d-38288003e1b2-delete_volume" released by "delete_volume" :: held 1.981s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:21 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.300s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Deleted volume successfully. Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0af4b68-f669-4036-8756-bf6c9e10830b tempest-VolumeSnapshotQuotasNegativeTestJSON-1694014750 None] Lock "cinder-67a01460-b5e5-44a4-9785-3c5c58adc271-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-fadfc406-8570-4689-b6da-adcda61e8feb-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-fadfc406-8570-4689-b6da-adcda61e8feb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-quobyte-fadfc406-8570-4689-b6da-adcda61e8feb" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-fadfc406-8570-4689-b6da-adcda61e8feb" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[31acf6f7-dc9d-4f6c-8775-2f5953a82efc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:22 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb Aug 26 00:17:22 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:22 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb" returned: 0 in 0.516s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:22 devstack sudo[108710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb Aug 26 00:17:22 devstack sudo[108710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:23 devstack sudo[108710]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fadfc406-8570-4689-b6da-adcda61e8feb" returned: 0 in 0.323s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-fadfc406-8570-4689-b6da-adcda61e8feb" released by "delete_volume" :: held 0.912s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Created reservations ['0822ae2f-84ef-436b-aa5b-d030e269c74e', '2e151f45-fa7e-4099-8139-7c9fc94a939f', '0625cc23-1d0b-4f13-95e8-b800fa145cae', '194ea035-27ee-4e48-9737-1c973ad5689d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:23 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:23 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:23 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Deleted volume successfully. Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-998fc1c2-0d5c-49fb-b7cf-cd1bc3526405 tempest-VolumesActionsTest-1963746977 None] Lock "cinder-fadfc406-8570-4689-b6da-adcda61e8feb-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:23 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (8e97d2da-ac93-4d74-b899-94eb09165a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1f5f1f-a64e-4ea5-9e57-1dc477faf32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc1f5f1f-a64e-4ea5-9e57-1dc477faf32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476596362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019d1f18-09ff-47c6-9672-ffe12210e562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:24Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd35376-41f5-4304-831f-f889e547ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd35376-41f5-4304-831f-f889e547ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54725cc7-988d-4154-b9a5-f89828cc2b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54725cc7-988d-4154-b9a5-f89828cc2b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '019d1f18-09ff-47c6-9672-ffe12210e562', 'volume_name': 'volume-019d1f18-09ff-47c6-9672-ffe12210e562', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece49f8-7a24-420b-9762-2f4857573aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ece49f8-7a24-420b-9762-2f4857573aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e359f36-3f53-49d0-a2d2-a674196dab09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:24 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Volume 019d1f18-09ff-47c6-9672-ffe12210e562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-019d1f18-09ff-47c6-9672-ffe12210e562', 'volume_size': 1} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1476596362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=019d1f18-09ff-47c6-9672-ffe12210e562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:24Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Creating volume 019d1f18-09ff-47c6-9672-ffe12210e562 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:24 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:24 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 1073741824 Aug 26 00:17:24 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:24 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 1073741824" returned: 0 in 0.496s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:24 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 Aug 26 00:17:24 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:25 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e359f36-3f53-49d0-a2d2-a674196dab09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-019d1f18-09ff-47c6-9672-ffe12210e562', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd89280-9548-42a9-8f64-344a2d4af2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Volume volume-019d1f18-09ff-47c6-9672-ffe12210e562 (019d1f18-09ff-47c6-9672-ffe12210e562): created successfully Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdd89280-9548-42a9-8f64-344a2d4af2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (8e97d2da-ac93-4d74-b899-94eb09165a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d5d085e-bd6b-43fd-bc49-5eabcd2e5209 tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-019d1f18-09ff-47c6-9672-ffe12210e562-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "cinder-019d1f18-09ff-47c6-9672-ffe12210e562-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Acquiring lock "cinder-quobyte-019d1f18-09ff-47c6-9672-ffe12210e562" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-019d1f18-09ff-47c6-9672-ffe12210e562" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2cdaff7-5c09-4b22-a297-7e108d97c308]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:26 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 Aug 26 00:17:26 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:27 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562" returned: 0 in 0.515s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:27 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562 Aug 26 00:17:27 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:27 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-019d1f18-09ff-47c6-9672-ffe12210e562" returned: 0 in 0.285s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "cinder-quobyte-019d1f18-09ff-47c6-9672-ffe12210e562" released by "delete_volume" :: held 0.874s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Created reservations ['ee20efdf-9a5e-41df-9db6-c2e9fe460982', '469fc537-f18b-4710-be69-68c4d838e4ab', '4e270ee9-f378-43b3-983e-c635a9142557', '60e6c5e4-b039-4618-89bb-28db0c3de416'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:27 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:27 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:28 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.421s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Deleted volume successfully. Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d8329f62-a87f-4501-850d-6cd1ad71484b tempest-VolumesActionsTest-1963746977 None] Lock "cinder-019d1f18-09ff-47c6-9672-ffe12210e562-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (a78520bb-0daa-447a-b2c5-43901e004eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea4741a-9c52-42e3-9575-c8aeea34ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea4741a-9c52-42e3-9575-c8aeea34ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1075295973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ebf3f3-0abb-43c3-8603-358a9d6f210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7350094c-e7e8-48ff-8cd3-0ab930c4b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7350094c-e7e8-48ff-8cd3-0ab930c4b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d21d7c9-b1c7-4d21-bb37-6bd005467796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d21d7c9-b1c7-4d21-bb37-6bd005467796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38ebf3f3-0abb-43c3-8603-358a9d6f210d', 'volume_name': 'volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cd5983-2c5b-4681-9446-1277778d0628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08cd5983-2c5b-4681-9446-1277778d0628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21283b46-f823-4bae-aa25-e13edb5d82bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Volume 38ebf3f3-0abb-43c3-8603-358a9d6f210d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d', 'volume_size': 1} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1075295973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38ebf3f3-0abb-43c3-8603-358a9d6f210d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a987968ffce49ddaf4bd569846c503b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='8cf3ccfd12a6403594f788510df6992e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Creating volume 38ebf3f3-0abb-43c3-8603-358a9d6f210d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:28 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:28 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d 1073741824 Aug 26 00:17:28 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Flow 'volume_create_manager' (adc5b705-b2c5-4aaf-a4eb-265ecf1a052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce143e-4b34-4d80-bab9-0f9f2bf0e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16ce143e-4b34-4d80-bab9-0f9f2bf0e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1944138717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f5954e-960c-4876-8c08-8fa90504a754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991259990c11405b9cd4c37622b643f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='3b97e62257b142cda761577af4cc716b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520dd12c-fc5e-4a36-b850-fa35c06df1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520dd12c-fc5e-4a36-b850-fa35c06df1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8118b1c4-4340-44dc-b084-4f03973a3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8118b1c4-4340-44dc-b084-4f03973a3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f5954e-960c-4876-8c08-8fa90504a754', 'volume_name': 'volume-48f5954e-960c-4876-8c08-8fa90504a754', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e6d230-8ca4-4ec4-8ea0-5e440c5d7afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e6d230-8ca4-4ec4-8ea0-5e440c5d7afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86ced2-5eb4-4bef-b48e-c197c7b8b03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Volume 48f5954e-960c-4876-8c08-8fa90504a754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f5954e-960c-4876-8c08-8fa90504a754', 'volume_size': 1} Aug 26 00:17:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:29 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d 1073741824" returned: 0 in 0.582s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:29 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d Aug 26 00:17:29 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Flow 'volume_create_manager' (a2d3d3f2-e394-4b57-a642-c0b6cab6b0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab22fb-cc72-4636-93b0-0a0606e5f5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ab22fb-cc72-4636-93b0-0a0606e5f5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93cfc7c-3ae7-4346-90ff-3e862e407569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecb732c334945988d0341c5e5495cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='8a89f977037c4bcabe5bdd81c5bbb3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014c379a-0d07-4db3-8295-6d3747b904f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014c379a-0d07-4db3-8295-6d3747b904f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750f5f3-1d65-4172-8c2c-3aa0486cd863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1750f5f3-1d65-4172-8c2c-3aa0486cd863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f93cfc7c-3ae7-4346-90ff-3e862e407569', 'volume_name': 'volume-f93cfc7c-3ae7-4346-90ff-3e862e407569', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb94a26-5c3f-4f2f-a20c-f8dce4363c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb94a26-5c3f-4f2f-a20c-f8dce4363c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779c1747-fbac-4fdb-8cfc-2dfa8dde49d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Volume f93cfc7c-3ae7-4346-90ff-3e862e407569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f93cfc7c-3ae7-4346-90ff-3e862e407569', 'volume_size': 1} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:29 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1944138717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f5954e-960c-4876-8c08-8fa90504a754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991259990c11405b9cd4c37622b643f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='3b97e62257b142cda761577af4cc716b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Creating volume 48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:29 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21283b46-f823-4bae-aa25-e13edb5d82bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 1073741824 Aug 26 00:17:29 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3585ce0-6f49-41e3-8c55-b53a05bf0142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Volume volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d (38ebf3f3-0abb-43c3-8603-358a9d6f210d): created successfully Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3585ce0-6f49-41e3-8c55-b53a05bf0142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Flow 'volume_create_manager' (a78520bb-0daa-447a-b2c5-43901e004eeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b3865d97-edcb-4cda-a5b6-532807994993 tempest-VolumesActionsTest-875578770 None] Created volume successfully. Aug 26 00:17:30 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 1073741824" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:30 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:30 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:30 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f93cfc7c-3ae7-4346-90ff-3e862e407569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecb732c334945988d0341c5e5495cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:29Z,use_quota=True,user_id='8a89f977037c4bcabe5bdd81c5bbb3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Creating volume f93cfc7c-3ae7-4346-90ff-3e862e407569 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:30 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f86ced2-5eb4-4bef-b48e-c197c7b8b03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f5954e-960c-4876-8c08-8fa90504a754', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5703b-4085-4dbb-a31f-1710052fb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:30 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 1073741824 Aug 26 00:17:30 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Volume volume-48f5954e-960c-4876-8c08-8fa90504a754 (48f5954e-960c-4876-8c08-8fa90504a754): created successfully Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51b5703b-4085-4dbb-a31f-1710052fb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Flow 'volume_create_manager' (adc5b705-b2c5-4aaf-a4eb-265ecf1a052d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:30 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3eed3916-0a18-4e47-a708-9ee9f52af676 tempest-SnapshotDependencyTests-380049556 None] Created volume successfully. Aug 26 00:17:30 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 1073741824" returned: 0 in 0.517s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:31 devstack sudo[108764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 Aug 26 00:17:31 devstack sudo[108764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-38ebf3f3-0abb-43c3-8603-358a9d6f210d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "cinder-38ebf3f3-0abb-43c3-8603-358a9d6f210d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Acquiring lock "cinder-quobyte-38ebf3f3-0abb-43c3-8603-358a9d6f210d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "cinder-quobyte-38ebf3f3-0abb-43c3-8603-358a9d6f210d" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7db90-0e55-40be-a7de-92402f0a5bfa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:31 devstack sudo[108764]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Flow 'volume_create_manager' (a6202986-4d34-439d-af0a-f30a293d481b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c273ca0-25bf-4f36-b448-1c80bf1828da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c273ca0-25bf-4f36-b448-1c80bf1828da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1302982897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062df390-3ddb-422e-a231-3e6dd96369a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45010dc020d3471a9f4e7feb073ed679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:31Z,use_quota=True,user_id='cdc90159db3b40a1871e95d47a39f605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b09ff353-c9b5-486d-a93d-7daf11c4cc99),volume_type_id=b09ff353-c9b5-486d-a93d-7daf11c4cc99)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd82bc90-dbc9-452a-8d44-6de2e77182c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd82bc90-dbc9-452a-8d44-6de2e77182c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea45bc7-df29-4903-b211-7e20ec82a790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea45bc7-df29-4903-b211-7e20ec82a790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062df390-3ddb-422e-a231-3e6dd96369a5', 'volume_name': 'volume-062df390-3ddb-422e-a231-3e6dd96369a5', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50f3f26-a8bf-4896-95cc-705c4d7974af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d50f3f26-a8bf-4896-95cc-705c4d7974af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803091f7-76f6-4699-9ef8-78539a6c888f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Volume 062df390-3ddb-422e-a231-3e6dd96369a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062df390-3ddb-422e-a231-3e6dd96369a5', 'volume_size': 1} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1302982897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062df390-3ddb-422e-a231-3e6dd96369a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45010dc020d3471a9f4e7feb073ed679',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:31Z,use_quota=True,user_id='cdc90159db3b40a1871e95d47a39f605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b09ff353-c9b5-486d-a93d-7daf11c4cc99),volume_type_id=b09ff353-c9b5-486d-a93d-7daf11c4cc99)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Creating volume 062df390-3ddb-422e-a231-3e6dd96369a5 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:31 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779c1747-fbac-4fdb-8cfc-2dfa8dde49d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f93cfc7c-3ae7-4346-90ff-3e862e407569', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 1073741824 Aug 26 00:17:31 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3992803e-e8fc-4704-ac0d-17a96e981f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Volume volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 (f93cfc7c-3ae7-4346-90ff-3e862e407569): created successfully Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3992803e-e8fc-4704-ac0d-17a96e981f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Flow 'volume_create_manager' (a2d3d3f2-e394-4b57-a642-c0b6cab6b0a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9dddc064-49a8-4522-80dd-a916ae91ce22 tempest-CinderUnicodeTest-1458003147 None] Created volume successfully. Aug 26 00:17:31 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d" returned: 0 in 0.430s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:31 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d Aug 26 00:17:31 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:32 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 1073741824" returned: 0 in 0.598s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:32 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-38ebf3f3-0abb-43c3-8603-358a9d6f210d" returned: 0 in 0.326s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "cinder-quobyte-38ebf3f3-0abb-43c3-8603-358a9d6f210d" released by "delete_volume" :: held 0.811s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:32 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 Aug 26 00:17:32 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Created reservations ['c7826fb9-6b8f-470e-ab64-a34591047beb', 'b528736f-a1d9-4355-844b-85cf05a23c70', 'c868a87c-cc78-437c-835b-d51759bd4216', '5b318cf3-1a2e-4862-ae34-37fb1903f81e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:32 devstack sudo[108783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:32 devstack sudo[108783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:32 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Flow 'volume_create_manager' (6319071f-acff-4d3c-a1b4-ee9b53ec57f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0533b-1154-4731-b0ac-32bfdb604e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.494s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9e0533b-1154-4731-b0ac-32bfdb604e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1669653824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1702ab6c-e0f2-49fc-ade8-61409dd14c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecb732c334945988d0341c5e5495cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:32Z,use_quota=True,user_id='8a89f977037c4bcabe5bdd81c5bbb3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ade2af-4be8-4297-a3fd-aa3ee3fbce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ade2af-4be8-4297-a3fd-aa3ee3fbce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae732f5-7480-4613-af08-eddbe4c7868e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ae732f5-7480-4613-af08-eddbe4c7868e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1702ab6c-e0f2-49fc-ade8-61409dd14c24', 'volume_name': 'volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa0738b-0b12-419b-9330-340e94bb9c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack sudo[108783]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa0738b-0b12-419b-9330-340e94bb9c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e67e0be-7968-45d2-9b3c-c6f871a8c262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Volume 1702ab6c-e0f2-49fc-ade8-61409dd14c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24', 'volume_size': 1} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803091f7-76f6-4699-9ef8-78539a6c888f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062df390-3ddb-422e-a231-3e6dd96369a5', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5c8e12-f309-44de-9287-fbef41510766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Creating offline snapshot 8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 of volume 48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.314s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Deleted volume successfully. Aug 26 00:17:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Volume volume-062df390-3ddb-422e-a231-3e6dd96369a5 (062df390-3ddb-422e-a231-3e6dd96369a5): created successfully Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d5c8e12-f309-44de-9287-fbef41510766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Flow 'volume_create_manager' (a6202986-4d34-439d-af0a-f30a293d481b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95f4a6-8099-4740-afd1-397dfae956d1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a6c56ea4-90c6-45e6-a4a0-8dde93774182 tempest-VolumeTypesAccessTest-1886603406 None] Created volume successfully. Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15e7d482-8753-45bf-a1f4-0c6305500562 tempest-VolumesActionsTest-875578770 None] Lock "cinder-38ebf3f3-0abb-43c3-8603-358a9d6f210d-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:32 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:32 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:32 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.411s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:33 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 1G Aug 26 00:17:33 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Acquiring lock "cinder-062df390-3ddb-422e-a231-3e6dd96369a5-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:33 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 1G" returned: 0 in 0.491s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f5954e-960c-4876-8c08-8fa90504a754 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "cinder-062df390-3ddb-422e-a231-3e6dd96369a5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:33 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f5954e-960c-4876-8c08-8fa90504a754 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:33 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Acquiring lock "cinder-quobyte-062df390-3ddb-422e-a231-3e6dd96369a5" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "cinder-quobyte-062df390-3ddb-422e-a231-3e6dd96369a5" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0276cd7d-e37d-47ae-8ded-4b441521a6af]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:33 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 Aug 26 00:17:33 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:33 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f5954e-960c-4876-8c08-8fa90504a754 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:33 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 is being set with open permissions: ugo+rw Aug 26 00:17:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:33 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:33 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:34 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5 Aug 26 00:17:34 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:34 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info Aug 26 00:17:34 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-062df390-3ddb-422e-a231-3e6dd96369a5" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "cinder-quobyte-062df390-3ddb-422e-a231-3e6dd96369a5" released by "delete_volume" :: held 0.737s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:34 devstack cinder-volume[94433]: WARNING cinder.quota [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1770908245 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1770908245, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:17:34 devstack cinder-volume[94433]: WARNING cinder.quota [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1770908245 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1770908245, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Created reservations ['437ea5ae-77d1-4e7b-919b-7a2be3d58bd3', 'd5e0f6cb-4cbd-4ab8-bff7-f51ffca8681c', '9710c783-9913-4c0d-bbda-7017acec7e3a', '10a4e4bc-f472-4f03-bbdf-c2dbf2fd1961'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:34 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info is being set with open permissions: ugo+rw Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:34 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info Aug 26 00:17:34 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:34 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:34 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.info" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.284s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:34 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:32Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1669653824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1702ab6c-e0f2-49fc-ade8-61409dd14c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fecb732c334945988d0341c5e5495cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:32Z,use_quota=True,user_id='8a89f977037c4bcabe5bdd81c5bbb3fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Creating volume 1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:34 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=108,cinder:UPDATE=149,cinder:INSERT=36,cinder:DELETE=12 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.321s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:34 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 1073741824 Aug 26 00:17:34 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Deleted volume successfully. Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=105,cinder:INSERT=38,cinder:UPDATE=128,cinder:DELETE=11 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:17:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-82c4b4ae-2b58-4977-97a4-34bfb2ccfdde tempest-SnapshotDependencyTests-380049556 None] Create snapshot completed successfully Aug 26 00:17:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-22ad1f49-1db6-4a88-855c-444922d4d204 tempest-VolumeTypesAccessTest-1886603406 None] Lock "cinder-062df390-3ddb-422e-a231-3e6dd96369a5-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:35 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 1073741824" returned: 0 in 0.616s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:35 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 Aug 26 00:17:35 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:35 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e67e0be-7968-45d2-9b3c-c6f871a8c262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfb23d4-a5e4-4522-8078-645aee85f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Volume volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 (1702ab6c-e0f2-49fc-ade8-61409dd14c24): created successfully Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfb23d4-a5e4-4522-8078-645aee85f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Flow 'volume_create_manager' (6319071f-acff-4d3c-a1b4-ee9b53ec57f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b70d78c1-9203-49c8-8139-c578bea2d8e2 tempest-CinderUnicodeTest-1458003147 None] Created volume successfully. Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Flow 'volume_create_manager' (f5ba25dd-ee1d-41b3-8cb3-c0067f4773fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b809b-ab1f-4c5f-bdf0-f90f48a533ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021b809b-ab1f-4c5f-bdf0-f90f48a533ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afd1ff7a-61d3-4936-b48e-f951e0bec0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991259990c11405b9cd4c37622b643f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e2f2c86-4bf4-4df5-bad3-b6e273eb9690,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:36Z,use_quota=True,user_id='3b97e62257b142cda761577af4cc716b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b43472-889d-4a0b-b563-5a79b5cc1375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b43472-889d-4a0b-b563-5a79b5cc1375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3906c0f0-3012-4cb0-8ef7-6a49b11a8007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3906c0f0-3012-4cb0-8ef7-6a49b11a8007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afd1ff7a-61d3-4936-b48e-f951e0bec0b8', 'volume_name': 'volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8', 'volume_size': 1, 'snapshot_id': '8e2f2c86-4bf4-4df5-bad3-b6e273eb9690'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3f58a7-7c01-4a0f-bff8-1830710a157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3f58a7-7c01-4a0f-bff8-1830710a157e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7978f4c-c1f5-41d9-aff8-c99452d15fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Volume afd1ff7a-61d3-4936-b48e-f951e0bec0b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8', 'volume_size': 1, 'snapshot_id': '8e2f2c86-4bf4-4df5-bad3-b6e273eb9690'} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Creating volume afd1ff7a-61d3-4936-b48e-f951e0bec0b8 from snapshot 8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] snapshot: 8e2f2c86-4bf4-4df5-bad3-b6e273eb9690, volume: afd1ff7a-61d3-4936-b48e-f951e0bec0b8, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c9d0c4-8a93-42e1-903e-a71835dd8ef3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:36 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:36 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:36 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.504s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f5954e-960c-4876-8c08-8fa90504a754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9814e9-2b5a-4998-af85-2b280a21de6d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:36 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:36 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:37 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.554s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:17:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:17:37 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:17:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:37 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 Aug 26 00:17:37 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:42 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" returned: 0 in 5.790s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:42 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:17:42 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Converted 1024.00 MB image at 176.81 MB/s Aug 26 00:17:42 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 is being set with open permissions: ugo+rw Aug 26 00:17:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:42 devstack sudo[108864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 Aug 26 00:17:42 devstack sudo[108864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:43 devstack sudo[108864]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" released by "_copy_volume_from_snapshot" :: held 7.232s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" released by "_create_volume_from_snapshot" :: held 7.312s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.331s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.321s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Creating offline snapshot 6d006e17-4b46-436e-90e4-cdeb0a9098e0 of volume 1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7978f4c-c1f5-41d9-aff8-c99452d15fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8', 'volume_size': 1, 'snapshot_id': '8e2f2c86-4bf4-4df5-bad3-b6e273eb9690'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22af9ea8-d58e-40f8-a416-d495cd5b85cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c3aef-4432-4691-989f-38b05a141caf]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:43 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Volume volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 (afd1ff7a-61d3-4936-b48e-f951e0bec0b8): created successfully Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22af9ea8-d58e-40f8-a416-d495cd5b85cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Flow 'volume_create_manager' (f5ba25dd-ee1d-41b3-8cb3-c0067f4773fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bf1e5288-9cf8-4244-ab76-94cd465b57a7 tempest-SnapshotDependencyTests-380049556 None] Created volume successfully. Aug 26 00:17:43 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 Aug 26 00:17:43 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:43 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:43 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 1G Aug 26 00:17:43 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Deleting offline snapshot 8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 of volume 48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] snapshot_file for this snap is: volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5eecb65-e25b-4e93-a87c-a190e308af53]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:44 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:44 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:44 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 1G" returned: 0 in 0.624s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:44 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 Aug 26 00:17:44 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:44 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.567s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f5954e-960c-4876-8c08-8fa90504a754(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0109ff-95d5-4696-9aaf-3c8b010e98e4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:44 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:44 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:44 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:44 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 is being set with open permissions: ugo+rw Aug 26 00:17:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:44 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 Aug 26 00:17:44 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:45 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:45 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info Aug 26 00:17:45 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:45 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.727s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:45 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:45 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:45 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info" returned: 0 in 0.307s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:45 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info is being set with open permissions: ugo+rw Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:45 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info Aug 26 00:17:45 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:45 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.500s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:45 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.info" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:45 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690 Aug 26 00:17:45 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6461a868-c9a3-4e3a-b12a-adf45c5155d4 tempest-CinderUnicodeTest-1458003147 None] Create snapshot completed successfully Aug 26 00:17:46 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754.8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690" released by "_delete_snapshot" :: held 2.212s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" released by "delete_snapshot" :: held 2.260s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Created reservations ['ade6d3d0-8d74-4332-b70e-0bc82e7a90cf', '99c18cf1-9c0a-457b-a453-0c13a2682a96', '0e079199-9e2a-4aac-a711-3fe0447ef62e', '17be303a-7772-4e43-a16d-af59b3c4f235'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Delete snapshot completed successfully. Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d9cda90-49cb-4eec-916c-b5bef7165da3 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-8e2f2c86-4bf4-4df5-bad3-b6e273eb9690-delete_snapshot" released by "delete_snapshot" :: held 2.449s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:46 devstack sudo[108913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:46 devstack sudo[108913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-6d006e17-4b46-436e-90e4-cdeb0a9098e0-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-6d006e17-4b46-436e-90e4-cdeb0a9098e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-quobyte-6d006e17-4b46-436e-90e4-cdeb0a9098e0" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-6d006e17-4b46-436e-90e4-cdeb0a9098e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Deleting offline snapshot 6d006e17-4b46-436e-90e4-cdeb0a9098e0 of volume 1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] snapshot_file for this snap is: volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[866490c4-3eca-4f86-a341-c13eca2da13b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:46 devstack sudo[108913]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:17:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:17:46 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 Aug 26 00:17:46 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-48f5954e-960c-4876-8c08-8fa90504a754-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-48f5954e-960c-4876-8c08-8fa90504a754-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44078e8-d893-49c7-aa77-20211376028a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:47 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0" returned: 0 in 0.485s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:17:47 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:47 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[413dd8fb-62d0-4c7f-8943-b8d8e03a968c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:47 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 Aug 26 00:17:47 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:47 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.441s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:47 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754 Aug 26 00:17:47 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:47 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24" returned: 0 in 0.417s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:47 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 Aug 26 00:17:47 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:47 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-48f5954e-960c-4876-8c08-8fa90504a754" returned: 0 in 0.318s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-48f5954e-960c-4876-8c08-8fa90504a754" released by "delete_volume" :: held 0.855s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Created reservations ['c2cd6de4-3d8a-4d3a-8fb8-5189069eb631', 'bb65d5b4-a2c1-4e71-8bf7-96a3e8b87560', '61569ddf-410e-49dd-8164-b0562edad426', 'f912fdb3-9110-4a32-967d-79ea913b02c4'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:48 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:48 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:48 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0" returned: 0 in 0.482s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-afd1ff7a-61d3-4936-b48e-f951e0bec0b8-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:48 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0 Aug 26 00:17:48 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-afd1ff7a-61d3-4936-b48e-f951e0bec0b8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9782bcb-d9fc-4a45-bfaa-a09ec8b5264a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:48 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Deleted volume successfully. Aug 26 00:17:48 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 Aug 26 00:17:48 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:48 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c5c00665-0fd3-4ad1-b16f-3abe4dd43f87 tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-48f5954e-960c-4876-8c08-8fa90504a754-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24.6d006e17-4b46-436e-90e4-cdeb0a9098e0" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-6d006e17-4b46-436e-90e4-cdeb0a9098e0" released by "_delete_snapshot" :: held 1.923s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" released by "delete_snapshot" :: held 1.961s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Created reservations ['38917ea3-59a5-47ce-acad-648bb8751d66', 'b7254e5a-626b-4c8f-b616-045033618a9c', '7824ea7f-c919-4d0d-aee6-edbee495f437', '79cbac64-3681-4e39-9bf2-4e87d70ab0ba'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Delete snapshot completed successfully. Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b4f0fed0-68e0-413c-a620-7906e21ea923 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-6d006e17-4b46-436e-90e4-cdeb0a9098e0-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:48 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" returned: 0 in 0.522s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:49 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8 Aug 26 00:17:49 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:49 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-quobyte-afd1ff7a-61d3-4936-b48e-f951e0bec0b8" released by "delete_volume" :: held 0.833s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Created reservations ['8fceb646-edb3-4cf8-b3cd-42c1049f7f82', '7714fa4e-9937-48c6-a0d6-7a7261269df8', '1a87261a-21a5-4a88-bf3e-e2900018fa34', '5e7f0000-4ccb-4257-907e-47ca5087cc6f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:49 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:49 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:49 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.307s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Deleted volume successfully. Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ced0a936-b2d7-4e38-b2dc-0e951cf14e4c tempest-SnapshotDependencyTests-380049556 None] Lock "cinder-afd1ff7a-61d3-4936-b48e-f951e0bec0b8-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-1702ab6c-e0f2-49fc-ade8-61409dd14c24-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-1702ab6c-e0f2-49fc-ade8-61409dd14c24-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[122a37c8-f316-4e84-b38e-d40fba496a61]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:50 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 Aug 26 00:17:50 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:50 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24" returned: 0 in 0.509s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:50 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24 Aug 26 00:17:50 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:51 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1702ab6c-e0f2-49fc-ade8-61409dd14c24" returned: 0 in 0.383s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-1702ab6c-e0f2-49fc-ade8-61409dd14c24" released by "delete_volume" :: held 1.018s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Created reservations ['8dac4029-1cf2-4064-8d11-5b23a18afbde', 'a0ecee00-8b15-4742-90bf-390222081973', '36cc3758-9a80-46c4-8b64-0e7c91569927', '42455c37-0664-4084-b70c-431e9a14ba2d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:51 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:51 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (0947c2cb-7d9d-4d04-8b74-57f12e234573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90b5045-6bb3-4e51-a7a4-48d655df0975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c90b5045-6bb3-4e51-a7a4-48d655df0975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876969146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab180d73-ca06-482a-be2a-d75cd7c1c0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:51Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbeaa79-4a31-44bf-903d-aab0034d8428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dbeaa79-4a31-44bf-903d-aab0034d8428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13513067-869a-45e2-aca2-941c72fe282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13513067-869a-45e2-aca2-941c72fe282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab180d73-ca06-482a-be2a-d75cd7c1c0da', 'volume_name': 'volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867917f3-f058-4114-b790-52e2a97bc3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (867917f3-f058-4114-b790-52e2a97bc3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3939da03-5f86-4abf-80fe-861496e63522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:51 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Volume ab180d73-ca06-482a-be2a-d75cd7c1c0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da', 'volume_size': 1} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-876969146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab180d73-ca06-482a-be2a-d75cd7c1c0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:51Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Creating volume ab180d73-ca06-482a-be2a-d75cd7c1c0da {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:51 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:51 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da 1073741824 Aug 26 00:17:51 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:51 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Deleted volume successfully. Aug 26 00:17:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-26bad457-1b09-4905-80df-dbbf9dc8a848 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-1702ab6c-e0f2-49fc-ade8-61409dd14c24-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:52 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da 1073741824" returned: 0 in 0.544s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:52 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da Aug 26 00:17:52 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:52 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da" returned: 0 in 0.310s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-f93cfc7c-3ae7-4346-90ff-3e862e407569-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3939da03-5f86-4abf-80fe-861496e63522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9aeae-dad3-469c-ac51-7ef6ddb31e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-f93cfc7c-3ae7-4346-90ff-3e862e407569-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Volume volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da (ab180d73-ca06-482a-be2a-d75cd7c1c0da): created successfully Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c9aeae-dad3-469c-ac51-7ef6ddb31e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (0947c2cb-7d9d-4d04-8b74-57f12e234573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-06dfeae2-af68-47cf-a46e-ca1c235b1fbd tempest-VolumesListAdminTestJSON-587994960 None] Created volume successfully. Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "cinder-quobyte-f93cfc7c-3ae7-4346-90ff-3e862e407569" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-f93cfc7c-3ae7-4346-90ff-3e862e407569" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7156051c-aec5-483e-95c9-9682595f1f4f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:52 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 Aug 26 00:17:52 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:52 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569" returned: 0 in 0.450s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:53 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569 Aug 26 00:17:53 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:53 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f93cfc7c-3ae7-4346-90ff-3e862e407569" returned: 0 in 0.292s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-quobyte-f93cfc7c-3ae7-4346-90ff-3e862e407569" released by "delete_volume" :: held 0.789s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Created reservations ['22dfd08a-2f02-4c73-b1ad-d6a64b141290', '2531137a-bb28-4fa1-ade0-21b61c9a9861', '5d82ff52-6c5d-4bfb-b1dd-e71f15115065', 'da485b56-7773-4a20-b9d8-34603b84211d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:53 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:17:53 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:53 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.332s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:17:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Deleted volume successfully. Aug 26 00:17:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35c00184-3d9c-4d2c-ba5a-47c58acfa786 tempest-CinderUnicodeTest-1458003147 None] Lock "cinder-f93cfc7c-3ae7-4346-90ff-3e862e407569-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (eeb1f0b6-d071-4c8e-a5a5-2378f1fdcbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ad5585-1dc6-403b-8f64-950ff6993dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1ad5585-1dc6-403b-8f64-950ff6993dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090477021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195a09d6-30f6-4057-910d-6f0c8d850a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:54Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005dc8d-8c86-4fd8-b2f0-00d758de4ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3005dc8d-8c86-4fd8-b2f0-00d758de4ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943e3c56-b0d8-4c0f-a8cc-34c90a17c7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (943e3c56-b0d8-4c0f-a8cc-34c90a17c7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195a09d6-30f6-4057-910d-6f0c8d850a6f', 'volume_name': 'volume-195a09d6-30f6-4057-910d-6f0c8d850a6f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824ee5d6-4b40-4607-926c-d681adc0af80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824ee5d6-4b40-4607-926c-d681adc0af80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d56a5-fd8e-4f9f-b7a4-b4f590ff6aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:54 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Volume 195a09d6-30f6-4057-910d-6f0c8d850a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195a09d6-30f6-4057-910d-6f0c8d850a6f', 'volume_size': 1} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2090477021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195a09d6-30f6-4057-910d-6f0c8d850a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:54Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Creating volume 195a09d6-30f6-4057-910d-6f0c8d850a6f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:54 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:54 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f 1073741824 Aug 26 00:17:54 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:55 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f 1073741824" returned: 0 in 0.618s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:55 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f Aug 26 00:17:55 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:55 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f" returned: 0 in 0.388s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396d56a5-fd8e-4f9f-b7a4-b4f590ff6aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195a09d6-30f6-4057-910d-6f0c8d850a6f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2a4f1f-5d5b-4eec-80b7-35a2d4b045a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:55 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Volume volume-195a09d6-30f6-4057-910d-6f0c8d850a6f (195a09d6-30f6-4057-910d-6f0c8d850a6f): created successfully Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2a4f1f-5d5b-4eec-80b7-35a2d4b045a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (eeb1f0b6-d071-4c8e-a5a5-2378f1fdcbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-16db1467-268a-4a35-9b48-dab5e9bb0582 tempest-VolumesListAdminTestJSON-587994960 None] Created volume successfully. Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Flow 'volume_create_manager' (52e225a5-9136-4120-9f2d-151785d7e59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13373ffd-7a54-4b34-8a85-5893bd93cb56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13373ffd-7a54-4b34-8a85-5893bd93cb56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1294500174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f52dd10-760b-4538-ba74-0656c0f97ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b70f4edf9e4ef5985f824e53933e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:56Z,use_quota=True,user_id='d4ea2e87a27c44d2b0a13de87fa6d6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fea4869-3bb4-42b5-8ca6-704c3d64083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fea4869-3bb4-42b5-8ca6-704c3d64083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a6a87e-ffb8-4b6f-9457-1462391b3aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a6a87e-ffb8-4b6f-9457-1462391b3aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f52dd10-760b-4538-ba74-0656c0f97ffc', 'volume_name': 'volume-1f52dd10-760b-4538-ba74-0656c0f97ffc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614c6042-847f-48e8-9196-35aadc2588f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (614c6042-847f-48e8-9196-35aadc2588f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92ff616-5c61-4281-baaa-1c29ca217fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Volume 1f52dd10-760b-4538-ba74-0656c0f97ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f52dd10-760b-4538-ba74-0656c0f97ffc', 'volume_size': 1} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1294500174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f52dd10-760b-4538-ba74-0656c0f97ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b70f4edf9e4ef5985f824e53933e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:56Z,use_quota=True,user_id='d4ea2e87a27c44d2b0a13de87fa6d6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Creating volume 1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:56 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:56 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc 1073741824 Aug 26 00:17:56 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:56 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc 1073741824" returned: 0 in 0.586s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:56 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:17:56 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (808f84ab-31ff-4f3b-b3bb-73a5e41dd4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34385cc0-6bee-4057-bf09-c67daf9c1622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34385cc0-6bee-4057-bf09-c67daf9c1622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1049357971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6055b42-3d61-4f81-9a04-1208def34c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:57Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71fb81d-6800-49c6-bd4d-5dde6c6f46df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71fb81d-6800-49c6-bd4d-5dde6c6f46df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38a2ac-2ff9-4020-9878-ca5778b0b110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38a2ac-2ff9-4020-9878-ca5778b0b110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6055b42-3d61-4f81-9a04-1208def34c1c', 'volume_name': 'volume-e6055b42-3d61-4f81-9a04-1208def34c1c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3f7a0-01b7-4b3f-b725-5908d5f54a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d3f7a0-01b7-4b3f-b725-5908d5f54a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d402891c-03d7-49c6-83fa-09d2e4a61200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Volume e6055b42-3d61-4f81-9a04-1208def34c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6055b42-3d61-4f81-9a04-1208def34c1c', 'volume_size': 1} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:57 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.291s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.120s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1049357971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6055b42-3d61-4f81-9a04-1208def34c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a2dfc5ef44f439ab0544a9c076d7f3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:57Z,use_quota=True,user_id='ed662c366a924bb1b9a2484e56892833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Creating volume e6055b42-3d61-4f81-9a04-1208def34c1c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92ff616-5c61-4281-baaa-1c29ca217fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f52dd10-760b-4538-ba74-0656c0f97ffc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556b70a6-1227-4738-b424-ce83106ea70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:57 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c 1073741824 Aug 26 00:17:57 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Volume volume-1f52dd10-760b-4538-ba74-0656c0f97ffc (1f52dd10-760b-4538-ba74-0656c0f97ffc): created successfully Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556b70a6-1227-4738-b424-ce83106ea70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Flow 'volume_create_manager' (52e225a5-9136-4120-9f2d-151785d7e59f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-07f44631-cb27-46ab-8005-0b15ac5b5839 tempest-VolumesCloneTest-1214664112 None] Created volume successfully. Aug 26 00:17:57 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c 1073741824" returned: 0 in 0.581s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:57 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c Aug 26 00:17:57 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:58 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d402891c-03d7-49c6-83fa-09d2e4a61200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6055b42-3d61-4f81-9a04-1208def34c1c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db545e7b-e6c1-437c-abaa-3ed30f2d435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Volume volume-e6055b42-3d61-4f81-9a04-1208def34c1c (e6055b42-3d61-4f81-9a04-1208def34c1c): created successfully Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db545e7b-e6c1-437c-abaa-3ed30f2d435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Flow 'volume_create_manager' (808f84ab-31ff-4f3b-b3bb-73a5e41dd4bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6b0f0e38-c4df-4dfc-8e6a-f171a4192791 tempest-VolumesListAdminTestJSON-587994960 None] Created volume successfully. Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Flow 'volume_create_manager' (5f72c8f1-3126-415a-a8d9-de60936d6813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a015166d-e10a-4947-969b-675e2c31908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a015166d-e10a-4947-969b-675e2c31908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208562978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d196513-f04a-4f69-b7de-52725fcbb47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ab008ac3b402f9b36d597125656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:58Z,use_quota=True,user_id='9c836f5f20b64ab58f9a15292d47d1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd592e63-baf7-4f20-b1d9-5e8596e74442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd592e63-baf7-4f20-b1d9-5e8596e74442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a577a161-4794-44ba-952e-0651db3d9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a577a161-4794-44ba-952e-0651db3d9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d196513-f04a-4f69-b7de-52725fcbb47e', 'volume_name': 'volume-9d196513-f04a-4f69-b7de-52725fcbb47e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b5f93-6dfd-4f8f-ad21-2b32bcf4c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134b5f93-6dfd-4f8f-ad21-2b32bcf4c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86937ec1-765f-4a48-a3f5-cb49ac79c78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Volume 9d196513-f04a-4f69-b7de-52725fcbb47e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d196513-f04a-4f69-b7de-52725fcbb47e', 'volume_size': 1} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208562978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d196513-f04a-4f69-b7de-52725fcbb47e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ab008ac3b402f9b36d597125656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:58Z,use_quota=True,user_id='9c836f5f20b64ab58f9a15292d47d1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Creating volume 9d196513-f04a-4f69-b7de-52725fcbb47e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:17:58 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:58 devstack sudo[109023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e 1073741824 Aug 26 00:17:58 devstack sudo[109023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Flow 'volume_create_manager' (eff77e5e-6dc9-4192-bec3-de2d8bd13af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a46fbb-2d8d-4b9f-875a-a59bcb0e38b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7a46fbb-2d8d-4b9f-875a-a59bcb0e38b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:17:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-480707549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0072262a-d308-4627-ae2b-84712902fad5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b70f4edf9e4ef5985f824e53933e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:17:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1f52dd10-760b-4538-ba74-0656c0f97ffc,status='creating',terminated_at=None,updated_at=2026-08-25T22:17:59Z,use_quota=True,user_id='d4ea2e87a27c44d2b0a13de87fa6d6bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152680ca-a7a7-40db-a1c1-4801639dc6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (152680ca-a7a7-40db-a1c1-4801639dc6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fecbc2-88f9-4c6c-9700-b33bf84d3ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29fecbc2-88f9-4c6c-9700-b33bf84d3ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0072262a-d308-4627-ae2b-84712902fad5', 'volume_name': 'volume-0072262a-d308-4627-ae2b-84712902fad5', 'volume_size': 2, 'source_volid': '1f52dd10-760b-4538-ba74-0656c0f97ffc', 'source_volstatus': 'available'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300c5196-8cc6-421b-902a-1aa5bb17e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (300c5196-8cc6-421b-902a-1aa5bb17e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67278fec-f8cd-4848-b1db-dfc3ec54cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Volume 0072262a-d308-4627-ae2b-84712902fad5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0072262a-d308-4627-ae2b-84712902fad5', 'volume_size': 2, 'source_volid': '1f52dd10-760b-4538-ba74-0656c0f97ffc', 'source_volstatus': 'available'} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:17:59 devstack sudo[109023]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e 1073741824" returned: 0 in 0.669s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:59 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e Aug 26 00:17:59 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:59 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.457s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:17:59 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Cloning volume 1f52dd10-760b-4538-ba74-0656c0f97ffc to volume 0072262a-d308-4627-ae2b-84712902fad5 Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86937ec1-765f-4a48-a3f5-cb49ac79c78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d196513-f04a-4f69-b7de-52725fcbb47e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae882cf-cb2f-428d-a2d9-691550351d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Volume volume-9d196513-f04a-4f69-b7de-52725fcbb47e (9d196513-f04a-4f69-b7de-52725fcbb47e): created successfully Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae882cf-cb2f-428d-a2d9-691550351d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Flow 'volume_create_manager' (5f72c8f1-3126-415a-a8d9-de60936d6813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Creating offline snapshot 1e1722d6-9d69-49f5-9754-a624b19f7836 of volume 1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:17:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0ce64ab1-a098-4c0f-a1b1-7a67d2264861 tempest-ProjectReaderTests-918453403 None] Created volume successfully. Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63b0184-5340-4549-80a9-091cadd53212]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:17:59 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:17:59 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Flow 'volume_create_manager' (77764098-b608-4375-9bf9-586399edc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44199c78-1bf5-4562-8891-7c605788d758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44199c78-1bf5-4562-8891-7c605788d758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502b681b-995f-465e-839c-f853b094c6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34edcd231105456c8c065f28419e1b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:00Z,use_quota=True,user_id='dba21f73450b43ff8180e1bf60d8d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b04478e-f7c8-4a4b-83ee-93bc1232c953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b04478e-f7c8-4a4b-83ee-93bc1232c953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97979c2b-d726-40e0-9db9-8406b592ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97979c2b-d726-40e0-9db9-8406b592ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502b681b-995f-465e-839c-f853b094c6b0', 'volume_name': 'volume-502b681b-995f-465e-839c-f853b094c6b0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9295c8d-a6a2-4c61-9d9b-39a2aad93676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:17:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9295c8d-a6a2-4c61-9d9b-39a2aad93676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb1d23d-1edc-4ec1-90a5-33cc2d4b0b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Volume 502b681b-995f-465e-839c-f853b094c6b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502b681b-995f-465e-839c-f853b094c6b0', 'volume_size': 1} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:00 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.518s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:00 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 1G Aug 26 00:18:00 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:00 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 1G" returned: 0 in 0.492s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f52dd10-760b-4538-ba74-0656c0f97ffc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:00 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f52dd10-760b-4538-ba74-0656c0f97ffc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:00 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Acquiring lock "cinder-9d196513-f04a-4f69-b7de-52725fcbb47e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "cinder-9d196513-f04a-4f69-b7de-52725fcbb47e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Acquiring lock "cinder-quobyte-9d196513-f04a-4f69-b7de-52725fcbb47e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "cinder-quobyte-9d196513-f04a-4f69-b7de-52725fcbb47e" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73e99a-be51-453c-a262-18789957624f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e Aug 26 00:18:01 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:01 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f52dd10-760b-4538-ba74-0656c0f97ffc -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.393s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:01 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 is being set with open permissions: ugo+rw Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:01 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:01 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:01 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e Aug 26 00:18:01 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info Aug 26 00:18:01 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:01 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9d196513-f04a-4f69-b7de-52725fcbb47e" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "cinder-quobyte-9d196513-f04a-4f69-b7de-52725fcbb47e" released by "delete_volume" :: held 0.727s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:01 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:01 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info is being set with open permissions: ugo+rw Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Created reservations ['d2556265-2206-42c7-b7f6-3e1148b12569', 'a8f0adcf-7205-45ed-8cb6-997cc60ddb88', '3f02b19f-0cdf-47de-8dd7-339038b683d7', 'ac5092f5-6fdb-4622-b66e-c3f76267e00f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:01 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info Aug 26 00:18:01 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:01 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:01 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:02 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.info" returned: 0 in 0.346s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] snapshot: 1e1722d6-9d69-49f5-9754-a624b19f7836, volume: 0072262a-d308-4627-ae2b-84712902fad5, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[842c9666-94df-48ba-85e3-760c47ae9a75]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:02 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.335s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Deleted volume successfully. Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d93daf27-bd1f-4fe1-8a11-347a07868981 tempest-ProjectReaderTests-918453403 None] Lock "cinder-9d196513-f04a-4f69-b7de-52725fcbb47e-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:02 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:02 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Flow 'volume_create_manager' (07bab781-7ea2-4fc2-b28d-5dcba539c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95400cb-bb62-49b0-bf02-5638e1e5c2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c95400cb-bb62-49b0-bf02-5638e1e5c2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297279569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32e1ae8-fd85-4213-8e1b-ff448af565b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ab008ac3b402f9b36d597125656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:02Z,use_quota=True,user_id='9c836f5f20b64ab58f9a15292d47d1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31347cc1-63ff-441d-92f0-96557ebdb55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31347cc1-63ff-441d-92f0-96557ebdb55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66575ba0-7170-44eb-a82f-8b88ade75c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66575ba0-7170-44eb-a82f-8b88ade75c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32e1ae8-fd85-4213-8e1b-ff448af565b9', 'volume_name': 'volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e575e941-3a92-4fdc-8f4d-f208ea4d12dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e575e941-3a92-4fdc-8f4d-f208ea4d12dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe4294c-bcb6-435f-9990-84efc64840e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Volume b32e1ae8-fd85-4213-8e1b-ff448af565b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9', 'volume_size': 1} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:02 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f52dd10-760b-4538-ba74-0656c0f97ffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d5220d-c6e1-41e6-b96b-ee0c827dee98]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:02 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:18:02 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:03 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.413s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:18:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:18:03 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:18:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:03 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 Aug 26 00:18:03 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:07 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5" returned: 0 in 4.195s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc, size 1024.00 MB, duration 4.20 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:18:07 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Converted 1024.00 MB image at 244.05 MB/s Aug 26 00:18:07 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 is being set with open permissions: ugo+rw Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:07 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 Aug 26 00:18:07 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:07 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" released by "_copy_volume_from_snapshot" :: held 5.440s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-quobyte-1e1722d6-9d69-49f5-9754-a624b19f7836" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-1e1722d6-9d69-49f5-9754-a624b19f7836" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Deleting offline snapshot 1e1722d6-9d69-49f5-9754-a624b19f7836 of volume 1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] snapshot_file for this snap is: volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf2109-84a1-4301-aa60-c6fb6952511c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:07 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:07 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:07 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f52dd10-760b-4538-ba74-0656c0f97ffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8b29f1-d1f8-4d01-b42b-c06fbebd111f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:08 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:18:08 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:08 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.523s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:08 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:08 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:08 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:08 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836 Aug 26 00:18:08 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:09 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc.1e1722d6-9d69-49f5-9754-a624b19f7836" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-1e1722d6-9d69-49f5-9754-a624b19f7836" released by "_delete_snapshot" :: held 1.551s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.573s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.130s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502b681b-995f-465e-839c-f853b094c6b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34edcd231105456c8c065f28419e1b8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:00Z,use_quota=True,user_id='dba21f73450b43ff8180e1bf60d8d238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Creating volume 502b681b-995f-465e-839c-f853b094c6b0 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67278fec-f8cd-4848-b1db-dfc3ec54cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0072262a-d308-4627-ae2b-84712902fad5', 'volume_size': 2, 'source_volid': '1f52dd10-760b-4538-ba74-0656c0f97ffc', 'source_volstatus': 'available'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:09 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 1073741824 Aug 26 00:18:09 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebd6815-7f4d-44f0-89bd-ea1ef410f935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Volume volume-0072262a-d308-4627-ae2b-84712902fad5 (0072262a-d308-4627-ae2b-84712902fad5): created successfully Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebd6815-7f4d-44f0-89bd-ea1ef410f935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Flow 'volume_create_manager' (eff77e5e-6dc9-4192-bec3-de2d8bd13af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-66c8f9d1-7221-4b29-bb09-ae3e08a6fc69 tempest-VolumesCloneTest-1214664112 None] Created volume successfully. Aug 26 00:18:09 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 1073741824" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:09 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 Aug 26 00:18:09 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:09 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.249s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297279569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32e1ae8-fd85-4213-8e1b-ff448af565b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b1ab008ac3b402f9b36d597125656b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:02Z,use_quota=True,user_id='9c836f5f20b64ab58f9a15292d47d1d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Creating volume b32e1ae8-fd85-4213-8e1b-ff448af565b9 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb1d23d-1edc-4ec1-90a5-33cc2d4b0b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502b681b-995f-465e-839c-f853b094c6b0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:09 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 1073741824 Aug 26 00:18:09 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991e8e7a-5d79-42a6-a75e-7ddcc2e170b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Volume volume-502b681b-995f-465e-839c-f853b094c6b0 (502b681b-995f-465e-839c-f853b094c6b0): created successfully Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991e8e7a-5d79-42a6-a75e-7ddcc2e170b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Flow 'volume_create_manager' (77764098-b608-4375-9bf9-586399edc154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-0072262a-d308-4627-ae2b-84712902fad5-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-22cef1b7-fb0a-4d18-b049-3e3f5478af2f tempest-VolumesListAdminTestJSON-2096548877 None] Created volume successfully. Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-0072262a-d308-4627-ae2b-84712902fad5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d300e32c-fe07-45fd-b177-82d3476e580c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:10 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 Aug 26 00:18:10 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:10 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 1073741824" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:10 devstack sudo[109177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 Aug 26 00:18:10 devstack sudo[109177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:10 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:10 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5 Aug 26 00:18:10 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:10 devstack sudo[109177]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe4294c-bcb6-435f-9990-84efc64840e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b273b6-522d-49d7-8486-9cee5699dfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Volume volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 (b32e1ae8-fd85-4213-8e1b-ff448af565b9): created successfully Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b273b6-522d-49d7-8486-9cee5699dfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Flow 'volume_create_manager' (07bab781-7ea2-4fc2-b28d-5dcba539c85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-55ebaf91-5501-4f69-a6e4-6a2d2b26a380 tempest-ProjectReaderTests-918453403 None] Created volume successfully. Aug 26 00:18:10 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0072262a-d308-4627-ae2b-84712902fad5" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-0072262a-d308-4627-ae2b-84712902fad5" released by "delete_volume" :: held 0.676s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Created reservations ['d36ae450-d9f4-40b3-86be-af887b372304', '1ce2b593-5872-4da8-80c7-6998ffa4b18f', '1105924f-4e82-43c1-b759-f1ac0c9f0a03', '95644756-349d-4286-9659-9ac5d41fb798'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Acquiring lock "cinder-502b681b-995f-465e-839c-f853b094c6b0-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:10 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:10 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "cinder-502b681b-995f-465e-839c-f853b094c6b0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Acquiring lock "cinder-quobyte-502b681b-995f-465e-839c-f853b094c6b0" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "cinder-quobyte-502b681b-995f-465e-839c-f853b094c6b0" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8624b963-1f77-40f0-8885-795b28b50c6a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-e6055b42-3d61-4f81-9a04-1208def34c1c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-e6055b42-3d61-4f81-9a04-1208def34c1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-quobyte-e6055b42-3d61-4f81-9a04-1208def34c1c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-e6055b42-3d61-4f81-9a04-1208def34c1c" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a567d-2851-46ef-b858-f96a6a16903a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 Aug 26 00:18:11 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.313s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Deleted volume successfully. Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7f49ff6c-03bf-4876-aee9-118d21eb0bc0 tempest-VolumesCloneTest-1214664112 None] Lock "cinder-0072262a-d308-4627-ae2b-84712902fad5-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:11 devstack sudo[109190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c Aug 26 00:18:11 devstack sudo[109190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-1f52dd10-760b-4538-ba74-0656c0f97ffc-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Acquiring lock "cinder-b32e1ae8-fd85-4213-8e1b-ff448af565b9-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "cinder-1f52dd10-760b-4538-ba74-0656c0f97ffc-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "cinder-b32e1ae8-fd85-4213-8e1b-ff448af565b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Acquiring lock "cinder-quobyte-1f52dd10-760b-4538-ba74-0656c0f97ffc" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Acquiring lock "cinder-quobyte-b32e1ae8-fd85-4213-8e1b-ff448af565b9" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-1f52dd10-760b-4538-ba74-0656c0f97ffc" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0" returned: 0 in 0.495s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cdd4c2-98f8-4f81-b4c1-9b576d5046ae]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "cinder-quobyte-b32e1ae8-fd85-4213-8e1b-ff448af565b9" acquired by "delete_volume" :: waited 0.076s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:11 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0 Aug 26 00:18:11 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbdba4e-8a9a-43ab-8e68-581484dac862]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack sudo[109190]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c" returned: 0 in 0.514s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack sudo[109199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:18:11 devstack sudo[109201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 Aug 26 00:18:11 devstack sudo[109199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack sudo[109204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c Aug 26 00:18:11 devstack sudo[109204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-502b681b-995f-465e-839c-f853b094c6b0" returned: 0 in 0.297s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "cinder-quobyte-502b681b-995f-465e-839c-f853b094c6b0" released by "delete_volume" :: held 0.846s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Created reservations ['ca606a4c-c20f-4392-8ad6-9387c4a35014', 'ad238da6-ae7e-4838-95de-a172ccad77f8', '00e3018e-6a3c-4857-bbe2-8acff23af7d0', 'b448df01-4cb9-47c7-a6ca-6f44a4539a10'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:11 devstack sudo[109204]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e6055b42-3d61-4f81-9a04-1208def34c1c" returned: 0 in 0.302s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack sudo[109199]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.431s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-e6055b42-3d61-4f81-9a04-1208def34c1c" released by "delete_volume" :: held 0.873s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:11 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc Aug 26 00:18:11 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:11 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:11 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:11 devstack sudo[109219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9 Aug 26 00:18:11 devstack sudo[109219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Created reservations ['1b836e08-2978-463e-b04e-fe822a3a8983', 'd61a46d1-9df2-4e13-8359-5d79e32392e4', '59111e13-beb4-4e4a-ac8a-76ae66aab309', 'be989321-4b0c-4af3-a1a6-5d7ce1ca97a5'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:12 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:12 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:12 devstack sudo[109219]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b32e1ae8-fd85-4213-8e1b-ff448af565b9" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "cinder-quobyte-b32e1ae8-fd85-4213-8e1b-ff448af565b9" released by "delete_volume" :: held 0.800s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:12 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-195a09d6-30f6-4057-910d-6f0c8d850a6f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1f52dd10-760b-4538-ba74-0656c0f97ffc" returned: 0 in 0.397s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "cinder-quobyte-1f52dd10-760b-4538-ba74-0656c0f97ffc" released by "delete_volume" :: held 0.947s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-195a09d6-30f6-4057-910d-6f0c8d850a6f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:12 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.447s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Deleted volume successfully. Aug 26 00:18:12 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Created reservations ['104ad216-71df-4774-9d19-2d02ba5af4e8', '0642a68b-037b-4d14-b804-e9d455345ff7', 'd994a8fd-97ce-4cdb-8d9e-eb09b7693257', '1c83c93b-9a9f-4da6-9e23-328fab16c7b8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Deleted volume successfully. Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-quobyte-195a09d6-30f6-4057-910d-6f0c8d850a6f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-195a09d6-30f6-4057-910d-6f0c8d850a6f" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0787afd1-faba-491a-90d4-4f86634fcf45 tempest-VolumesListAdminTestJSON-2096548877 None] Lock "cinder-502b681b-995f-465e-839c-f853b094c6b0-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfea243-37c7-4972-903d-cbef8e7d2b09]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e424b466-ffc7-48e3-b901-9c2c8ac80ba0 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-e6055b42-3d61-4f81-9a04-1208def34c1c-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Created reservations ['e69e1f64-ff15-4129-9dc0-f75ce6c7e986', 'cf042661-214e-4ed5-9f71-d672c75aa334', '35837cc4-07a7-4ea9-9e0f-eaed1b914869', 'e426f202-d2a1-44f3-8068-608012da20e8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:12 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:12 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:12 devstack sudo[109229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f Aug 26 00:18:12 devstack sudo[109229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:12 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:12 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:13 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.308s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Deleted volume successfully. Aug 26 00:18:13 devstack sudo[109229]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f" returned: 0 in 0.385s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d742450-85c1-433b-9cfb-965ea05a52ac tempest-ProjectReaderTests-918453403 None] Lock "cinder-b32e1ae8-fd85-4213-8e1b-ff448af565b9-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:13 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:13 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f Aug 26 00:18:13 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.301s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Deleted volume successfully. Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4bd88470-ce24-4aac-8791-97fef27983ce tempest-VolumesCloneTest-1214664112 None] Lock "cinder-1f52dd10-760b-4538-ba74-0656c0f97ffc-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:13 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-195a09d6-30f6-4057-910d-6f0c8d850a6f" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-195a09d6-30f6-4057-910d-6f0c8d850a6f" released by "delete_volume" :: held 0.681s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Created reservations ['3bf75003-84c4-4efa-9cc0-9cec78ab7304', '21c1c459-70c3-492e-8277-aaa99b7b5fee', 'ce1e421d-6816-4d8d-870c-fa0efe2d7e80', '4cf0f80b-fda9-4ecf-83ed-7153a40bbd9e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:13 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:13 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-ab180d73-ca06-482a-be2a-d75cd7c1c0da-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-ab180d73-ca06-482a-be2a-d75cd7c1c0da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "cinder-quobyte-ab180d73-ca06-482a-be2a-d75cd7c1c0da" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-ab180d73-ca06-482a-be2a-d75cd7c1c0da" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:13 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Deleted volume successfully. Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a033aa-8130-4ec6-9c70-c9d1da38aa05]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c1b3d21-0f92-4028-b7b5-e35eee05917b tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-195a09d6-30f6-4057-910d-6f0c8d850a6f-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:13 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da Aug 26 00:18:13 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:14 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da" returned: 0 in 0.433s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:14 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da Aug 26 00:18:14 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:14 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ab180d73-ca06-482a-be2a-d75cd7c1c0da" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-quobyte-ab180d73-ca06-482a-be2a-d75cd7c1c0da" released by "delete_volume" :: held 0.787s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Created reservations ['7eb74fc4-ce44-4f43-a24f-f5ceacf2a132', '942eddd0-bec5-4832-8905-6c8eba53e22d', '4770e1f8-b495-4325-9507-15b5f654da7b', 'f2e42f1e-7870-4292-a75a-4e59512bc2a6'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:14 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:14 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:14 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.352s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Deleted volume successfully. Aug 26 00:18:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3c9aff6f-bb39-4f8e-bb13-f681ef658684 tempest-VolumesListAdminTestJSON-587994960 None] Lock "cinder-ab180d73-ca06-482a-be2a-d75cd7c1c0da-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (12612e07-84ab-403a-99dd-c25aa6cecb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4952410-d593-4c77-8b33-ef05a8fdf6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4952410-d593-4c77-8b33-ef05a8fdf6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1739733189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3d10b-a899-4711-971c-a414da381077,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:18Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c7c3b-ef90-4c88-86cf-80ed9e972d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847c7c3b-ef90-4c88-86cf-80ed9e972d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fca1055-114b-4ffc-ad8a-62034df87ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fca1055-114b-4ffc-ad8a-62034df87ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc3d10b-a899-4711-971c-a414da381077', 'volume_name': 'volume-6dc3d10b-a899-4711-971c-a414da381077', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab63c8c2-7690-4fee-8c6c-ed10608b6172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab63c8c2-7690-4fee-8c6c-ed10608b6172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ddae3-6cd2-4f32-b269-a5212668ee0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:17 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Volume 6dc3d10b-a899-4711-971c-a414da381077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc3d10b-a899-4711-971c-a414da381077', 'volume_size': 1} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1739733189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dc3d10b-a899-4711-971c-a414da381077,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:18Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Creating volume 6dc3d10b-a899-4711-971c-a414da381077 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:17 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:17 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 1073741824 Aug 26 00:18:17 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:18 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 1073741824" returned: 0 in 0.510s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:18 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 Aug 26 00:18:18 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:18 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2ddae3-6cd2-4f32-b269-a5212668ee0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc3d10b-a899-4711-971c-a414da381077', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949e91d5-239a-43b6-9600-86273e5af343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Volume volume-6dc3d10b-a899-4711-971c-a414da381077 (6dc3d10b-a899-4711-971c-a414da381077): created successfully Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949e91d5-239a-43b6-9600-86273e5af343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (12612e07-84ab-403a-99dd-c25aa6cecb17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-452b26ce-0c02-4afc-975c-e9fe060176ed tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Flow 'volume_create_manager' (fcc7953c-e78f-4d8e-85cc-07302bd90cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997c2d76-a98d-4712-a3ce-09b8ef7655cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997c2d76-a98d-4712-a3ce-09b8ef7655cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-48971890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55741765-b96e-485c-8ce3-146cd2ccc296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27126c87caa64b589f87ac5452e58dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:20Z,use_quota=True,user_id='5ae4dcd705ba42f8a677be3da2842a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15e46bb-172d-422a-8c65-1881d0f60758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15e46bb-172d-422a-8c65-1881d0f60758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82c39d9-2037-492b-98fc-739b1916366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (09819230-8c01-43d3-a2b7-7bf540816874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f6a61d-92a4-46fd-8183-d4e72af1d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f6a61d-92a4-46fd-8183-d4e72af1d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-460514516',display_name='tempest-VolumesGetTest-Volume-1167789727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4ba359-44a8-4392-ac6a-c0e88d303972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:21Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113ebd4c-8f6a-464e-9d57-b4efaf91139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113ebd4c-8f6a-464e-9d57-b4efaf91139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ed454d-9630-454b-8cab-c845a6661263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ed454d-9630-454b-8cab-c845a6661263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4ba359-44a8-4392-ac6a-c0e88d303972', 'volume_name': 'volume-3e4ba359-44a8-4392-ac6a-c0e88d303972', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc53433f-050c-4d75-b786-c0012e1bdfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc53433f-050c-4d75-b786-c0012e1bdfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e195634b-9e98-4f6c-bd07-bc4b47150c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Volume 3e4ba359-44a8-4392-ac6a-c0e88d303972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4ba359-44a8-4392-ac6a-c0e88d303972', 'volume_size': 1} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-460514516',display_name='tempest-VolumesGetTest-Volume-1167789727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4ba359-44a8-4392-ac6a-c0e88d303972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:21Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Creating volume 3e4ba359-44a8-4392-ac6a-c0e88d303972 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:20 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:20 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 1073741824 Aug 26 00:18:20 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c82c39d9-2037-492b-98fc-739b1916366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55741765-b96e-485c-8ce3-146cd2ccc296', 'volume_name': 'volume-55741765-b96e-485c-8ce3-146cd2ccc296', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963c5b22-2fbd-4e6c-bd8d-ae4cbccb9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963c5b22-2fbd-4e6c-bd8d-ae4cbccb9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6b985f-7db6-4ae3-bc8f-0c31032f31d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:20 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Volume 55741765-b96e-485c-8ce3-146cd2ccc296: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55741765-b96e-485c-8ce3-146cd2ccc296', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 00:18:20 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Trying to clone 55741765-b96e-485c-8ce3-146cd2ccc296 from image 6c58b25c-448f-497b-9741-4b65985b8a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:18:21 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Image download 20.69 MB at 20.69 MB/s Aug 26 00:18:21 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 1073741824" returned: 0 in 0.521s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a435d46-1429-4da3-b01b-273aa9e70d0d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:21 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 Aug 26 00:18:21 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:21 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD Aug 26 00:18:21 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:21 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e195634b-9e98-4f6c-bd07-bc4b47150c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4ba359-44a8-4392-ac6a-c0e88d303972', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859db886-bb12-4f30-8cb7-e3757f1d2dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Volume volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 (3e4ba359-44a8-4392-ac6a-c0e88d303972): created successfully Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859db886-bb12-4f30-8cb7-e3757f1d2dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (09819230-8c01-43d3-a2b7-7bf540816874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:21 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c is fetched for user 5ae4dcd705ba42f8a677be3da2842a59. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:18:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d150e29b-03eb-4f10-98fc-3d7667929653 tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b7f19-b4d6-4402-9c1b-01eaf5b199a5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:21 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD Aug 26 00:18:21 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:22 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-48971890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55741765-b96e-485c-8ce3-146cd2ccc296,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27126c87caa64b589f87ac5452e58dac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:20Z,use_quota=True,user_id='5ae4dcd705ba42f8a677be3da2842a59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Creating volume 55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:22 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:22 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1073741824 Aug 26 00:18:22 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:22 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1073741824" returned: 0 in 0.405s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:22 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 Aug 26 00:18:22 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:22 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Attempting download of 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 55741765-b96e-485c-8ce3-146cd2ccc296. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a662a2-bd6e-41a7-80b3-4376eff913e2]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-3e4ba359-44a8-4392-ac6a-c0e88d303972-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "cinder-3e4ba359-44a8-4392-ac6a-c0e88d303972-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-3e4ba359-44a8-4392-ac6a-c0e88d303972" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-3e4ba359-44a8-4392-ac6a-c0e88d303972" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:22 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua Aug 26 00:18:22 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8a35fa-9a96-48dc-bc26-dafa88f96125]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 Aug 26 00:18:23 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua Aug 26 00:18:23 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972 Aug 26 00:18:23 devstack sudo[109307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua" returned: 1 in 0.323s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_z2uoi_ua' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abb5a17-3f30-4db8-92ed-99f260c0442b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109307]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3e4ba359-44a8-4392-ac6a-c0e88d303972" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-3e4ba359-44a8-4392-ac6a-c0e88d303972" released by "delete_volume" :: held 0.673s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:23 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD Aug 26 00:18:23 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Created reservations ['b74bd572-587e-4e9b-8d1a-afc4fa99b1d0', '38f43e02-0bd5-4696-a924-e1eef875f505', '8afc80b8-2b24-4710-8d8c-992061b15af2', '0b987297-0a51-45e7-9a88-f5b9072edce6'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:23 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] 6c58b25c-448f-497b-9741-4b65985b8a7c was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:23 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 Aug 26 00:18:23 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:23 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:23 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a24d0779-d911-495d-a61f-7f2b154d02ac tempest-VolumesGetTest-2135784397 None] Lock "cinder-3e4ba359-44a8-4392-ac6a-c0e88d303972-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-6dc3d10b-a899-4711-971c-a414da381077-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "cinder-6dc3d10b-a899-4711-971c-a414da381077-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-6dc3d10b-a899-4711-971c-a414da381077" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-6dc3d10b-a899-4711-971c-a414da381077" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c11cdbe-e779-473a-92cf-60e3f45991a0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:24 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 Aug 26 00:18:24 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:24 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:24 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077 Aug 26 00:18:24 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:24 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-6dc3d10b-a899-4711-971c-a414da381077" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-6dc3d10b-a899-4711-971c-a414da381077" released by "delete_volume" :: held 0.657s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Created reservations ['36ff1188-b73f-46f8-9728-0384689ef2a2', 'd821d699-b417-4d47-8db3-e5206c7267ee', '21a69b2b-4000-436a-a2c4-5e2f0bd33a94', 'fb303b74-f785-4843-b0cc-af5fddc7484e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:24 devstack sudo[109335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:24 devstack sudo[109335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:25 devstack sudo[109335]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-55bd1e7e-60af-4698-b7bd-0ec78e267e9d tempest-VolumesGetTest-2135784397 None] Lock "cinder-6dc3d10b-a899-4711-971c-a414da381077-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:25 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296" returned: 0 in 1.749s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c__r6sntosdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:18:25 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Converted 112.00 MB image at 64.00 MB/s Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:25 devstack sudo[109338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1G Aug 26 00:18:25 devstack sudo[109338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (a6f886f4-ebb1-4015-9d73-19d7ef4f9af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b40976-cf31-4446-8c5d-1e335a2a82a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b40976-cf31-4446-8c5d-1e335a2a82a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596706175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9cee5-c062-4569-958f-32cb267ea3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:26Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3111297-b10f-427f-aff5-284911760034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3111297-b10f-427f-aff5-284911760034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b785ca1-019d-4a11-8e9e-c0c9b4aa5b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b785ca1-019d-4a11-8e9e-c0c9b4aa5b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bed9cee5-c062-4569-958f-32cb267ea3de', 'volume_name': 'volume-bed9cee5-c062-4569-958f-32cb267ea3de', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cd401f-16c8-47a9-901a-0f0b3e0d99cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1cd401f-16c8-47a9-901a-0f0b3e0d99cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f5aa4-772f-4246-821d-cf90ec9e04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Volume bed9cee5-c062-4569-958f-32cb267ea3de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bed9cee5-c062-4569-958f-32cb267ea3de', 'volume_size': 1} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-596706175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bed9cee5-c062-4569-958f-32cb267ea3de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:26Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Creating volume bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:25 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:25 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de 1073741824 Aug 26 00:18:25 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:25 devstack sudo[109338]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 1G" returned: 0 in 0.344s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Downloaded image 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 55741765-b96e-485c-8ce3-146cd2ccc296 successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c for user 5ae4dcd705ba42f8a677be3da2842a59 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Marking volume 55741765-b96e-485c-8ce3-146cd2ccc296 as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Copying metadata from image 6c58b25c-448f-497b-9741-4b65985b8a7c to 55741765-b96e-485c-8ce3-146cd2ccc296. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Creating volume glance metadata for volume 55741765-b96e-485c-8ce3-146cd2ccc296 backed by image 6c58b25c-448f-497b-9741-4b65985b8a7c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:18:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a6b985f-7db6-4ae3-bc8f-0c31032f31d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55741765-b96e-485c-8ce3-146cd2ccc296', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88daa4c3-658f-49ca-be17-26267ba74ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Volume volume-55741765-b96e-485c-8ce3-146cd2ccc296 (55741765-b96e-485c-8ce3-146cd2ccc296): created successfully Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88daa4c3-658f-49ca-be17-26267ba74ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Flow 'volume_create_manager' (fcc7953c-e78f-4d8e-85cc-07302bd90cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ce1617aa-002a-466b-bead-e748e89716b1 tempest-VolumesImageMetadata-1101992480 None] Created volume successfully. Aug 26 00:18:26 devstack sudo[109343]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de 1073741824" returned: 0 in 0.437s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:26 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:26 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:26 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.245s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253f5aa4-772f-4246-821d-cf90ec9e04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bed9cee5-c062-4569-958f-32cb267ea3de', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd35f52-39dd-46be-a310-1df43338cfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Volume volume-bed9cee5-c062-4569-958f-32cb267ea3de (bed9cee5-c062-4569-958f-32cb267ea3de): created successfully Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd35f52-39dd-46be-a310-1df43338cfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (a6f886f4-ebb1-4015-9d73-19d7ef4f9af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-820f7925-8fae-40b4-a4c8-8c99969882f5 tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Acquiring lock "cinder-55741765-b96e-485c-8ce3-146cd2ccc296-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "cinder-55741765-b96e-485c-8ce3-146cd2ccc296-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Acquiring lock "cinder-quobyte-55741765-b96e-485c-8ce3-146cd2ccc296" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "cinder-quobyte-55741765-b96e-485c-8ce3-146cd2ccc296" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbe8751-3bed-4829-85af-2417270ba422]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:27 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 Aug 26 00:18:27 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (40a706db-d931-4396-99ff-39853aaffbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f00ce-2ba7-46b5-b483-747006162c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15f00ce-2ba7-46b5-b483-747006162c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-369201579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519e758a-d697-44a3-bad2-30ad4a1dae9d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bed9cee5-c062-4569-958f-32cb267ea3de,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:27Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6663f5-1bf9-4952-bb18-df60e8bba730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6663f5-1bf9-4952-bb18-df60e8bba730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:27 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58befa20-fd28-4bad-b456-414a5765cdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296" returned: 0 in 0.377s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58befa20-fd28-4bad-b456-414a5765cdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '519e758a-d697-44a3-bad2-30ad4a1dae9d', 'volume_name': 'volume-519e758a-d697-44a3-bad2-30ad4a1dae9d', 'volume_size': 1, 'source_volid': 'bed9cee5-c062-4569-958f-32cb267ea3de', 'source_volstatus': 'available'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:27 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296 Aug 26 00:18:27 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6fe57d-4b76-42ae-9458-cb776fae7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6fe57d-4b76-42ae-9458-cb776fae7e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f5017c-4c75-4e4d-99eb-ac7fd12c1362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:27 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Volume 519e758a-d697-44a3-bad2-30ad4a1dae9d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-519e758a-d697-44a3-bad2-30ad4a1dae9d', 'volume_size': 1, 'source_volid': 'bed9cee5-c062-4569-958f-32cb267ea3de', 'source_volstatus': 'available'} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:27 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Cloning volume bed9cee5-c062-4569-958f-32cb267ea3de to volume 519e758a-d697-44a3-bad2-30ad4a1dae9d Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Creating offline snapshot 4d375886-7f21-4f2b-a88d-fd021c77305d of volume bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a3e40-9f98-4358-9558-7af0725a238a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:27 devstack sudo[109360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:27 devstack sudo[109360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:27 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-55741765-b96e-485c-8ce3-146cd2ccc296" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "cinder-quobyte-55741765-b96e-485c-8ce3-146cd2ccc296" released by "delete_volume" :: held 0.676s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Created reservations ['2d1a758f-f45f-4cba-8151-9f9751e7507b', '731de6ac-812a-4509-ab55-6e13641905f0', '56ea783c-b5a7-4908-91ed-e46104948710', '0eeba024-5909-4dc3-a9aa-44db286efddf'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:27 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:27 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:27 devstack sudo[109360]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:27 devstack sudo[109369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d 1G Aug 26 00:18:27 devstack sudo[109369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:28 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Deleted volume successfully. Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d707b0c6-ce10-4fd9-9f1d-01be96439891 tempest-VolumesImageMetadata-1101992480 None] Lock "cinder-55741765-b96e-485c-8ce3-146cd2ccc296-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:28 devstack sudo[109369]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d 1G" returned: 0 in 0.415s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed9cee5-c062-4569-958f-32cb267ea3de -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:28 devstack sudo[109375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed9cee5-c062-4569-958f-32cb267ea3de -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:28 devstack sudo[109375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:28 devstack sudo[109375]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bed9cee5-c062-4569-958f-32cb267ea3de -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.315s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:28 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d is being set with open permissions: ugo+rw Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:28 devstack sudo[109381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:28 devstack sudo[109381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:28 devstack sudo[109381]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:28 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info Aug 26 00:18:28 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:29 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:29 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info is being set with open permissions: ugo+rw Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:29 devstack sudo[109387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info Aug 26 00:18:29 devstack sudo[109387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:29 devstack sudo[109387]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.info" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] snapshot: 4d375886-7f21-4f2b-a88d-fd021c77305d, volume: 519e758a-d697-44a3-bad2-30ad4a1dae9d, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[36318e44-9752-4f22-89f7-4c3c45ad23ef]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:29 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:29 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:29 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed9cee5-c062-4569-958f-32cb267ea3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d8c07b-6613-48a6-b327-61dc7c863a18]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:30 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:30 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:30 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:30 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d Aug 26 00:18:30 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Flow 'volume_create_manager' (762bae0d-2b7f-45de-a194-0fb1e17cace9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d1a47f-8870-4151-9c0b-5cb80ddb6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d1a47f-8870-4151-9c0b-5cb80ddb6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1366394170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f7f044-ad95-420b-9bad-425d5bc701b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf735df47e8f4747ac6e7ff8aa67e744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:31Z,use_quota=True,user_id='cc82b62bec7d426999a9a9a4afac54f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a3d21e-ad1a-47d9-ab21-d7748f3eb947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31a3d21e-ad1a-47d9-ab21-d7748f3eb947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf5fa94-9981-47c0-9763-ef9aacb5043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf5fa94-9981-47c0-9763-ef9aacb5043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f7f044-ad95-420b-9bad-425d5bc701b6', 'volume_name': 'volume-39f7f044-ad95-420b-9bad-425d5bc701b6', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83827ff3-0b13-40d1-b8f6-481ea5585ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83827ff3-0b13-40d1-b8f6-481ea5585ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a05fc1-5620-42a8-89f7-0a0a9776d1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Volume 39f7f044-ad95-420b-9bad-425d5bc701b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f7f044-ad95-420b-9bad-425d5bc701b6', 'volume_size': 1} Aug 26 00:18:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:34 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d" returned: 0 in 4.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:18:34 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Converted 1024.00 MB image at 239.01 MB/s Aug 26 00:18:34 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d is being set with open permissions: ugo+rw Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:34 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d Aug 26 00:18:34 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:34 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d" returned: 0 in 0.235s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" released by "_copy_volume_from_snapshot" :: held 5.311s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-4d375886-7f21-4f2b-a88d-fd021c77305d" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-4d375886-7f21-4f2b-a88d-fd021c77305d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Deleting offline snapshot 4d375886-7f21-4f2b-a88d-fd021c77305d of volume bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] snapshot_file for this snap is: volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51d89a2-426c-46df-90d5-d9d5c3a5bce9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:34 devstack sudo[109420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:34 devstack sudo[109420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:35 devstack sudo[109420]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bed9cee5-c062-4569-958f-32cb267ea3de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40c8a38-7a6b-4e08-99d8-34b3f176ef1d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:35 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:35 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:35 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.521s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:35 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:35 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:36 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.313s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:36 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d Aug 26 00:18:36 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:36 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de.4d375886-7f21-4f2b-a88d-fd021c77305d" returned: 0 in 0.236s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-4d375886-7f21-4f2b-a88d-fd021c77305d" released by "_delete_snapshot" :: held 1.498s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=137,cinder:UPDATE=168,cinder:DELETE=18,cinder:INSERT=45 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:DELETE=14,cinder:SELECT=130,cinder:INSERT=55,cinder:UPDATE=192 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.953s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.369s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1366394170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f7f044-ad95-420b-9bad-425d5bc701b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf735df47e8f4747ac6e7ff8aa67e744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:31Z,use_quota=True,user_id='cc82b62bec7d426999a9a9a4afac54f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Creating volume 39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:36 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:36 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 1073741824 Aug 26 00:18:36 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f5017c-4c75-4e4d-99eb-ac7fd12c1362) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519e758a-d697-44a3-bad2-30ad4a1dae9d', 'volume_size': 1, 'source_volid': 'bed9cee5-c062-4569-958f-32cb267ea3de', 'source_volstatus': 'available'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff197b5-5121-43e2-81ab-cd177bc3009c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Volume volume-519e758a-d697-44a3-bad2-30ad4a1dae9d (519e758a-d697-44a3-bad2-30ad4a1dae9d): created successfully Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff197b5-5121-43e2-81ab-cd177bc3009c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (40a706db-d931-4396-99ff-39853aaffbd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9c0d481a-4f2e-4c92-8feb-2d2d8cc0b49f tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:36 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 1073741824" returned: 0 in 0.413s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:36 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 Aug 26 00:18:36 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:37 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a05fc1-5620-42a8-89f7-0a0a9776d1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f7f044-ad95-420b-9bad-425d5bc701b6', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2daec4c-6787-42c3-a66e-08905c245d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Volume volume-39f7f044-ad95-420b-9bad-425d5bc701b6 (39f7f044-ad95-420b-9bad-425d5bc701b6): created successfully Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2daec4c-6787-42c3-a66e-08905c245d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Flow 'volume_create_manager' (762bae0d-2b7f-45de-a194-0fb1e17cace9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-aeea5613-7350-47a4-b397-a7dd3603c867 tempest-SnapshotMetadataTestJSON-481485876 None] Created volume successfully. Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (1e9326a6-92bd-4b8e-b9af-83e1a25d702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b246cf0d-33dd-4ab0-b984-a32a321a3a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b246cf0d-33dd-4ab0-b984-a32a321a3a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1979208581',display_name='tempest-VolumesGetTest-Volume-17126333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd5036-a21f-4877-aa3c-2a37831c1c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:38Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4f1d08-e6b8-4633-8255-777f24093332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e4f1d08-e6b8-4633-8255-777f24093332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8a165e-0bbf-46f9-8729-992ac8e17e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8a165e-0bbf-46f9-8729-992ac8e17e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7cd5036-a21f-4877-aa3c-2a37831c1c13', 'volume_name': 'volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ade83-9e85-4f48-af49-4c96a72e12b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241ade83-9e85-4f48-af49-4c96a72e12b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7048ae6c-c0f0-4850-8465-5eab2f9b11c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Volume b7cd5036-a21f-4877-aa3c-2a37831c1c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13', 'volume_size': 1} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1979208581',display_name='tempest-VolumesGetTest-Volume-17126333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7cd5036-a21f-4877-aa3c-2a37831c1c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:38Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Creating volume b7cd5036-a21f-4877-aa3c-2a37831c1c13 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:37 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 1073741824 Aug 26 00:18:37 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:38 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 1073741824" returned: 0 in 0.407s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:38 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 Aug 26 00:18:38 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:38 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13" returned: 0 in 0.237s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.650s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Creating offline snapshot e26bbd59-ea71-4590-a1f3-5ba14c044c6e of volume 39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7048ae6c-c0f0-4850-8465-5eab2f9b11c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decc1cb7-3a61-4f0c-98ba-cd75dbb98e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d07963-ceee-4ac4-8243-872193725641]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Volume volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 (b7cd5036-a21f-4877-aa3c-2a37831c1c13): created successfully Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (decc1cb7-3a61-4f0c-98ba-cd75dbb98e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (1e9326a6-92bd-4b8e-b9af-83e1a25d702b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bdc6b341-d2c9-46ec-b110-d1d7cf67ec6a tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:38 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 Aug 26 00:18:38 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-b7cd5036-a21f-4877-aa3c-2a37831c1c13-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "cinder-b7cd5036-a21f-4877-aa3c-2a37831c1c13-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-b7cd5036-a21f-4877-aa3c-2a37831c1c13" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-b7cd5036-a21f-4877-aa3c-2a37831c1c13" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dd96f7-328f-40e8-9284-ce0bcc9940d6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:38 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e 1G Aug 26 00:18:39 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 Aug 26 00:18:39 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13" returned: 0 in 0.363s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13 Aug 26 00:18:39 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e 1G" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7f044-ad95-420b-9bad-425d5bc701b6 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7f044-ad95-420b-9bad-425d5bc701b6 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e Aug 26 00:18:39 devstack sudo[109474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b7cd5036-a21f-4877-aa3c-2a37831c1c13" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-b7cd5036-a21f-4877-aa3c-2a37831c1c13" released by "delete_volume" :: held 0.656s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Created reservations ['b311ae46-ba04-41d9-b676-dc450fe6538f', '0853a529-ff65-40e9-b3fe-b53e3718a78b', 'ed1aef06-15ed-4996-b948-e60a674c93e7', '11ef7572-eb98-4eb5-b9d2-d8ff0b26c64f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:39 devstack sudo[109474]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39f7f044-ad95-420b-9bad-425d5bc701b6 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e" returned: 0 in 0.308s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:39 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e is being set with open permissions: ugo+rw Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e Aug 26 00:18:39 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:39 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:39 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:39 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:40 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info Aug 26 00:18:40 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b817d9-6c7d-4281-a388-97b6b7a4da63 tempest-VolumesGetTest-2135784397 None] Lock "cinder-b7cd5036-a21f-4877-aa3c-2a37831c1c13-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-519e758a-d697-44a3-bad2-30ad4a1dae9d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "cinder-519e758a-d697-44a3-bad2-30ad4a1dae9d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5aca4b-a6f6-46ae-90b9-7d08c5fc1d7e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:40 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:40 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info is being set with open permissions: ugo+rw Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:40 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d Aug 26 00:18:40 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:40 devstack sudo[109490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info Aug 26 00:18:40 devstack sudo[109490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:40 devstack sudo[109490]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.info" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:40 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:40 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d Aug 26 00:18:40 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-43f2ae1f-7a58-466d-bceb-894a9acee990 tempest-SnapshotMetadataTestJSON-481485876 None] Create snapshot completed successfully Aug 26 00:18:40 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-519e758a-d697-44a3-bad2-30ad4a1dae9d" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-519e758a-d697-44a3-bad2-30ad4a1dae9d" released by "delete_volume" :: held 0.658s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Created reservations ['c91289d8-7fd8-4ede-a79b-744f70de2dad', '823374d1-fb20-4fdb-b395-3c3bee729436', '16d2df6b-08c2-41ea-9116-980a6338e3d7', 'ebe89fdb-5ed0-4168-a6f2-8d2097dad101'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:40 devstack sudo[109500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:40 devstack sudo[109500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:41 devstack sudo[109500]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-54610bd0-aa80-445f-98ea-deeee22ef118 tempest-VolumesGetTest-2135784397 None] Lock "cinder-519e758a-d697-44a3-bad2-30ad4a1dae9d-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-bed9cee5-c062-4569-958f-32cb267ea3de-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "cinder-bed9cee5-c062-4569-958f-32cb267ea3de-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-bed9cee5-c062-4569-958f-32cb267ea3de" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-bed9cee5-c062-4569-958f-32cb267ea3de" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc12f66-ed56-4863-8111-5d3bf6cc682c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "cinder-e26bbd59-ea71-4590-a1f3-5ba14c044c6e-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:41 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:41 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-e26bbd59-ea71-4590-a1f3-5ba14c044c6e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "cinder-quobyte-e26bbd59-ea71-4590-a1f3-5ba14c044c6e" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-e26bbd59-ea71-4590-a1f3-5ba14c044c6e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Deleting offline snapshot e26bbd59-ea71-4590-a1f3-5ba14c044c6e of volume 39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] snapshot_file for this snap is: volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[853963ea-fe82-4e4c-a500-8b8a3b444b1b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:41 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e Aug 26 00:18:41 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:41 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:41 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de Aug 26 00:18:41 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:42 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e" returned: 0 in 0.385s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39f7f044-ad95-420b-9bad-425d5bc701b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68b104-f3bb-49bd-a37a-b802f33eff3a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:42 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bed9cee5-c062-4569-958f-32cb267ea3de" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-bed9cee5-c062-4569-958f-32cb267ea3de" released by "delete_volume" :: held 0.731s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Created reservations ['dd894b31-f4a3-4d4c-86d7-f8c3ea120288', '6d4d28a2-9ace-44fe-a829-822628b0fdc4', 'bbdc0ccb-e2fe-4a9f-a447-ae2b3d45e362', 'e7dce8a6-7565-4f4e-bb4a-ccbd3e17a04c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:42 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 Aug 26 00:18:42 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:42 devstack sudo[109519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:42 devstack sudo[109519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:42 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:42 devstack sudo[109524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e Aug 26 00:18:42 devstack sudo[109524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:42 devstack sudo[109519]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.294s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:42 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0d96a03a-c6c8-4fd4-bf8e-6bb144b2b17d tempest-VolumesGetTest-2135784397 None] Lock "cinder-bed9cee5-c062-4569-958f-32cb267ea3de-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:42 devstack sudo[109524]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:42 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e Aug 26 00:18:42 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:43 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6.e26bbd59-ea71-4590-a1f3-5ba14c044c6e" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-e26bbd59-ea71-4590-a1f3-5ba14c044c6e" released by "_delete_snapshot" :: held 1.498s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" released by "delete_snapshot" :: held 1.532s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Created reservations ['fd3110d8-f995-4b91-bf2f-7c3ade77b3f8', '071d8d91-f0f5-4719-ae4c-3bc71bf0c3d2', '31bc1ad0-cd2b-48c3-8c02-c14c4e9b09b3', '192a66cd-8d9c-4d87-93db-f06bc0877226'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (f104b917-c39e-4018-a429-cf97a997bc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3d8c06-17fc-4890-9ec7-880d8dd263bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d3d8c06-17fc-4890-9ec7-880d8dd263bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1751071600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861f581a-aec6-4474-9b0c-051589dd635f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:43Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a96e66d-7a0a-4cf4-a64c-d6505696a925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a96e66d-7a0a-4cf4-a64c-d6505696a925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c89a49-bde1-4228-8015-4cab1d0f6a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:18:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Delete snapshot completed successfully. Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41e041f-6160-46b5-a6d5-e1eb8bb4438b tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-e26bbd59-ea71-4590-a1f3-5ba14c044c6e-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c89a49-bde1-4228-8015-4cab1d0f6a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '861f581a-aec6-4474-9b0c-051589dd635f', 'volume_name': 'volume-861f581a-aec6-4474-9b0c-051589dd635f', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478bfce5-30e3-4346-9ff1-33bd4c7103c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478bfce5-30e3-4346-9ff1-33bd4c7103c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab37077-895a-4022-9c42-2bf9f10e9ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:43 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Volume 861f581a-aec6-4474-9b0c-051589dd635f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-861f581a-aec6-4474-9b0c-051589dd635f', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Trying to clone 861f581a-aec6-4474-9b0c-051589dd635f from image 6c58b25c-448f-497b-9741-4b65985b8a7c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "cinder-39f7f044-ad95-420b-9bad-425d5bc701b6-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-39f7f044-ad95-420b-9bad-425d5bc701b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:18:43 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Image download 20.69 MB at 20.69 MB/s Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e810a244-9ebe-44dc-9c76-59ec623c8fbc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add1896-938e-40ad-aa34-10bb7a7442c8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 Aug 26 00:18:44 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:44 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD Aug 26 00:18:44 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:44 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6" returned: 0 in 0.400s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c is fetched for user 526939023305454ba2a1bc3fc2512769. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:18:44 devstack sudo[109547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6 Aug 26 00:18:44 devstack sudo[109547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c8cdd0-ee12-41dc-9b87-1f881c41d327]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD Aug 26 00:18:44 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:44 devstack sudo[109547]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39f7f044-ad95-420b-9bad-425d5bc701b6" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-quobyte-39f7f044-ad95-420b-9bad-425d5bc701b6" released by "delete_volume" :: held 0.715s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Created reservations ['630092a6-8d56-4e22-836a-6d9d213de73c', '72f770b1-195a-46e4-b250-232cc385b357', 'bccd8084-5abb-4c3e-8daa-846dcdb888f6', 'c554236a-e77b-454e-a9ec-afe443e2d610'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:44 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:44 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1751071600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=861f581a-aec6-4474-9b0c-051589dd635f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:43Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Creating volume 861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:44 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:44 devstack sudo[109557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1073741824 Aug 26 00:18:44 devstack sudo[109557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:45 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Deleted volume successfully. Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6d44b28c-cdb6-4c9a-b60d-261bfaf77520 tempest-SnapshotMetadataTestJSON-481485876 None] Lock "cinder-39f7f044-ad95-420b-9bad-425d5bc701b6-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:45 devstack sudo[109557]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1073741824" returned: 0 in 0.484s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:45 devstack sudo[109564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f Aug 26 00:18:45 devstack sudo[109564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:45 devstack sudo[109564]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Attempting download of 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 861f581a-aec6-4474-9b0c-051589dd635f. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5bab5d-ec59-4a3d-9c1b-7db08cd81c99]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:45 devstack sudo[109567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9 Aug 26 00:18:45 devstack sudo[109567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:46 devstack sudo[109567]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9" returned: 0 in 0.344s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:46 devstack sudo[109571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9 Aug 26 00:18:46 devstack sudo[109571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:46 devstack sudo[109571]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9" returned: 1 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c58b25c-448f-497b-9741-4b65985b8a7c_bqvbyhi9' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f993d61-a7dc-4961-82df-5495f977b0d0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:46 devstack sudo[109576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD Aug 26 00:18:46 devstack sudo[109576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:46 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:46 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:46 devstack sudo[109576]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] 6c58b25c-448f-497b-9741-4b65985b8a7c was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:46 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:18:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:18:46 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f Aug 26 00:18:46 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Flow 'volume_create_manager' (e9d11c5d-260b-4029-9977-630f5e52a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5491d43d-b2b7-43a8-b531-9fff4a5b91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5491d43d-b2b7-43a8-b531-9fff4a5b91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1133498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccb1243-7c15-4d1f-9194-bd413043628c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cde4e9f4a174a9b973269bb1ebae731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:48Z,use_quota=True,user_id='94653354702149dca3eb810cd1e30f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bc5b92-636e-478a-bd23-19ca53ab210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6bc5b92-636e-478a-bd23-19ca53ab210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cce162-ca76-4414-a50d-02c0612e1917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59cce162-ca76-4414-a50d-02c0612e1917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fccb1243-7c15-4d1f-9194-bd413043628c', 'volume_name': 'volume-fccb1243-7c15-4d1f-9194-bd413043628c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16e6e5-b8f9-4627-a21f-f65d7933fc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a16e6e5-b8f9-4627-a21f-f65d7933fc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5f4547-aa67-4e04-b76a-7118d2d58bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Volume fccb1243-7c15-4d1f-9194-bd413043628c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fccb1243-7c15-4d1f-9194-bd413043628c', 'volume_size': 1} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1133498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fccb1243-7c15-4d1f-9194-bd413043628c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cde4e9f4a174a9b973269bb1ebae731',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:48Z,use_quota=True,user_id='94653354702149dca3eb810cd1e30f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Creating volume fccb1243-7c15-4d1f-9194-bd413043628c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:48 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:48 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c 1073741824 Aug 26 00:18:48 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:48 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f" returned: 0 in 1.779s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c58b25c-448f-497b-9741-4b65985b8a7c_rlx6xcd5devstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:18:48 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Converted 112.00 MB image at 62.90 MB/s Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:48 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1G Aug 26 00:18:48 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:48 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c 1073741824" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:48 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c Aug 26 00:18:48 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:48 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f 1G" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Downloaded image 6c58b25c-448f-497b-9741-4b65985b8a7c ((None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}])) to volume 861f581a-aec6-4474-9b0c-051589dd635f successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Temporary image 6c58b25c-448f-497b-9741-4b65985b8a7c for user 526939023305454ba2a1bc3fc2512769 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Marking volume 861f581a-aec6-4474-9b0c-051589dd635f as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:18:48 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Copying metadata from image 6c58b25c-448f-497b-9741-4b65985b8a7c to 861f581a-aec6-4474-9b0c-051589dd635f. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Creating volume glance metadata for volume 861f581a-aec6-4474-9b0c-051589dd635f backed by image 6c58b25c-448f-497b-9741-4b65985b8a7c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e5f4547-aa67-4e04-b76a-7118d2d58bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fccb1243-7c15-4d1f-9194-bd413043628c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528d893c-8b51-4b85-b810-fea66afbe009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:48 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Volume volume-fccb1243-7c15-4d1f-9194-bd413043628c (fccb1243-7c15-4d1f-9194-bd413043628c): created successfully Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (528d893c-8b51-4b85-b810-fea66afbe009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Flow 'volume_create_manager' (e9d11c5d-260b-4029-9977-630f5e52a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e4dd481c-fb31-4888-919b-b53eb783c155 tempest-VolumesMetadataTest-1948829235 None] Created volume successfully. Aug 26 00:18:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab37077-895a-4022-9c42-2bf9f10e9ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-861f581a-aec6-4474-9b0c-051589dd635f', 'volume_size': 1, 'image_id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c58b25c-448f-497b-9741-4b65985b8a7c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7afce026a05e4d8ea88f77b1308632c9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6c58b25c-448f-497b-9741-4b65985b8a7c', 'created_at': datetime.datetime(2026, 8, 25, 22, 0, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 0, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c58b25c-448f-497b-9741-4b65985b8a7c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d776e6d7-aae6-4c39-96a9-a728210c18b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:49 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Volume volume-861f581a-aec6-4474-9b0c-051589dd635f (861f581a-aec6-4474-9b0c-051589dd635f): created successfully Aug 26 00:18:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d776e6d7-aae6-4c39-96a9-a728210c18b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (f104b917-c39e-4018-a429-cf97a997bc6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1da8ec9f-5018-4eaf-97c2-b23e2dc4bdb0 tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (2f96af72-954c-4cf7-824d-2e501af88a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3176897e-d2c3-4777-8789-7c274bf731ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3176897e-d2c3-4777-8789-7c274bf731ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025922326',display_name='tempest-VolumesGetTest-Volume-548621589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c77e24-3d7e-44c1-90d1-2ace2ec2c802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:50Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d02113-4f77-46a7-8cb9-c29b52d045b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51d02113-4f77-46a7-8cb9-c29b52d045b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5258c1ce-be0c-4ef7-9bc3-8b958fe2487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5258c1ce-be0c-4ef7-9bc3-8b958fe2487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c77e24-3d7e-44c1-90d1-2ace2ec2c802', 'volume_name': 'volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81798823-eb9b-420e-850e-673c0b5ccb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81798823-eb9b-420e-850e-673c0b5ccb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27acf927-561e-43e5-8e10-0719fffa4740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:50 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Volume c8c77e24-3d7e-44c1-90d1-2ace2ec2c802: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802', 'volume_size': 1} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2025922326',display_name='tempest-VolumesGetTest-Volume-548621589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c77e24-3d7e-44c1-90d1-2ace2ec2c802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da9907920e6f4506837e8e97bb398d54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:50Z,use_quota=True,user_id='526939023305454ba2a1bc3fc2512769',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Creating volume c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:50 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:50 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 1073741824 Aug 26 00:18:50 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:50 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 1073741824" returned: 0 in 0.477s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Acquiring lock "cinder-fccb1243-7c15-4d1f-9194-bd413043628c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:50 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 Aug 26 00:18:50 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "cinder-fccb1243-7c15-4d1f-9194-bd413043628c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Acquiring lock "cinder-quobyte-fccb1243-7c15-4d1f-9194-bd413043628c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "cinder-quobyte-fccb1243-7c15-4d1f-9194-bd413043628c" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3135b246-5da1-4515-9e91-5713382488d9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:51 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c Aug 26 00:18:51 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:51 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27acf927-561e-43e5-8e10-0719fffa4740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd17840-8918-44c6-85e2-c10ee7534161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:51 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Volume volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 (c8c77e24-3d7e-44c1-90d1-2ace2ec2c802): created successfully Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd17840-8918-44c6-85e2-c10ee7534161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Flow 'volume_create_manager' (2f96af72-954c-4cf7-824d-2e501af88a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1df3457b-e740-4b6d-960d-810dd2e91ed9 tempest-VolumesGetTest-2135784397 None] Created volume successfully. Aug 26 00:18:51 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:51 devstack sudo[109622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c Aug 26 00:18:51 devstack sudo[109622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:51 devstack sudo[109622]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fccb1243-7c15-4d1f-9194-bd413043628c" returned: 0 in 0.240s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "cinder-quobyte-fccb1243-7c15-4d1f-9194-bd413043628c" released by "delete_volume" :: held 0.683s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Created reservations ['2f7d6703-466c-424c-a1a0-d3d173517077', 'f3beca5e-bbcc-47b7-9980-b33bc4912c62', '53d925d5-911e-498b-b554-e215c6a87a13', '72cc4c2f-016b-41ea-9c05-4fb5333b1de8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:51 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:51 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:51 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Deleted volume successfully. Aug 26 00:18:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-faabf2e6-d596-4aa7-a544-1a61e47bfc50 tempest-VolumesMetadataTest-1948829235 None] Lock "cinder-fccb1243-7c15-4d1f-9194-bd413043628c-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "cinder-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac71e2c5-2aa8-4019-829f-4b56a451d8d6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:52 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 Aug 26 00:18:52 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:52 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:52 devstack sudo[109634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802 Aug 26 00:18:52 devstack sudo[109634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:53 devstack sudo[109634]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802" released by "delete_volume" :: held 0.669s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Created reservations ['c3da6c77-a675-4e2f-920a-78d4f66528e1', 'f522a98d-f96a-4c90-a54d-0f00dddd78f1', 'cd2d0059-db44-4818-aeed-7d54f26fd20b', '8bcdd404-1a21-4c22-858f-69976dd69eab'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:53 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:53 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:53 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-93ea1509-a2dc-480a-a3b6-94e1bf4f5f94 tempest-VolumesGetTest-2135784397 None] Lock "cinder-c8c77e24-3d7e-44c1-90d1-2ace2ec2c802-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-861f581a-aec6-4474-9b0c-051589dd635f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "cinder-861f581a-aec6-4474-9b0c-051589dd635f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Acquiring lock "cinder-quobyte-861f581a-aec6-4474-9b0c-051589dd635f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-861f581a-aec6-4474-9b0c-051589dd635f" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b1bdb-4d79-4a16-9c5f-7866339e447c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:53 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f Aug 26 00:18:53 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:54 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f" returned: 0 in 0.388s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:54 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f Aug 26 00:18:54 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:54 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-861f581a-aec6-4474-9b0c-051589dd635f" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "cinder-quobyte-861f581a-aec6-4474-9b0c-051589dd635f" released by "delete_volume" :: held 0.685s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Created reservations ['0d85d596-f113-4acc-8868-6760064832dc', '883a4fe1-fbc9-4595-949f-819e805ec656', '16d20bc2-6b59-42a0-bbf3-79c57c12627f', 'dc9bdbc5-f7a3-4b71-8d37-41b04901d754'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:54 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:54 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:54 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.276s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:18:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Deleted volume successfully. Aug 26 00:18:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f28870fc-52e6-422e-8ad3-55033cd3636e tempest-VolumesGetTest-2135784397 None] Lock "cinder-861f581a-aec6-4474-9b0c-051589dd635f-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Flow 'volume_create_manager' (594d520e-1261-4701-a0a5-78973a695e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cb8a13-9b97-468a-9f2f-16b89349a61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38cb8a13-9b97-468a-9f2f-16b89349a61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672668910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19435b1ed4a07a0b331791210b22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:57Z,use_quota=True,user_id='cf1316bc6fa94648a68c99bb52bc0764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65151a60-23e9-43cd-ab30-f5347285cf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65151a60-23e9-43cd-ab30-f5347285cf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817a30b-d8f0-4ac1-8149-1462763b0fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5817a30b-d8f0-4ac1-8149-1462763b0fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d', 'volume_name': 'volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeefd558-3a9c-4cb0-a6c8-934c724a3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeefd558-3a9c-4cb0-a6c8-934c724a3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5d53e8-aee6-4f5c-b467-38b26887b654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Volume ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d', 'volume_size': 1} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1672668910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19435b1ed4a07a0b331791210b22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:57Z,use_quota=True,user_id='cf1316bc6fa94648a68c99bb52bc0764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Creating volume ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:56 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:56 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d 1073741824 Aug 26 00:18:56 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:57 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d 1073741824" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:57 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d Aug 26 00:18:57 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:57 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5d53e8-aee6-4f5c-b467-38b26887b654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb586531-41f5-4384-8e6a-b80ade27c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Volume volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d (ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d): created successfully Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb586531-41f5-4384-8e6a-b80ade27c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Flow 'volume_create_manager' (594d520e-1261-4701-a0a5-78973a695e49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-dab31a77-2d31-4500-834f-424469b13a7b tempest-VolumesTransfersV357Test-1126613295 None] Created volume successfully. Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Flow 'volume_create_manager' (c7d4d882-5233-45d3-bf99-d3fe9c30cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e854e-9aa5-4d23-a7e3-364265fe1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f09e854e-9aa5-4d23-a7e3-364265fe1988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1669207732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3492097e-3d8d-41f1-b499-382224ef5683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690eea5f774069a060444e84dd4ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:58Z,use_quota=True,user_id='7c3cfedc5467439ea2bd6f5c1a777462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a9279-95ba-4eeb-b443-e6f7ae3803ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db7a9279-95ba-4eeb-b443-e6f7ae3803ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03e1390-6d9c-42b2-92e2-2bb92e0bd2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a03e1390-6d9c-42b2-92e2-2bb92e0bd2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3492097e-3d8d-41f1-b499-382224ef5683', 'volume_name': 'volume-3492097e-3d8d-41f1-b499-382224ef5683', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef20ffa-00ae-4521-ae3a-97014944a7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef20ffa-00ae-4521-ae3a-97014944a7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3ecd9e-beb4-4ee6-930b-adbcdcd2e8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Volume 3492097e-3d8d-41f1-b499-382224ef5683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3492097e-3d8d-41f1-b499-382224ef5683', 'volume_size': 1} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1669207732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3492097e-3d8d-41f1-b499-382224ef5683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28690eea5f774069a060444e84dd4ebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:18:58Z,use_quota=True,user_id='7c3cfedc5467439ea2bd6f5c1a777462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Creating volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:18:58 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:58 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 1073741824 Aug 26 00:18:58 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-34a47818-cf77-4c18-a599-cb402b12b0ea tempest-VolumesTransfersV357Test-1886595254 None] Transfer volume completed successfully. Aug 26 00:18:58 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 1073741824" returned: 0 in 0.459s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:58 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 Aug 26 00:18:58 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "cinder-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:58 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683" returned: 0 in 0.266s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3ecd9e-beb4-4ee6-930b-adbcdcd2e8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3492097e-3d8d-41f1-b499-382224ef5683', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506604f-81bd-4034-814e-9992e3b93d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:18:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Volume volume-3492097e-3d8d-41f1-b499-382224ef5683 (3492097e-3d8d-41f1-b499-382224ef5683): created successfully Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506604f-81bd-4034-814e-9992e3b93d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Flow 'volume_create_manager' (c7d4d882-5233-45d3-bf99-d3fe9c30cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "cinder-quobyte-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:18:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fe391087-da83-4bfa-bd09-987ec1d4d98c tempest-VolumesSnapshotListTestJSON-1596375981 None] Created volume successfully. Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-quobyte-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1299f23a-d0bf-4372-afc3-fdee19b9eba2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:59 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d Aug 26 00:18:59 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Creating offline snapshot 1647b49a-97a9-4dc7-a8c9-1ea414cf6598 of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[919ce882-8be4-47f9-bb14-bb0aa01f2f48]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:59 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" returned: 0 in 0.402s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:59 devstack sudo[109680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 Aug 26 00:18:59 devstack sudo[109680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:59 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d Aug 26 00:18:59 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:59 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-quobyte-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d" released by "delete_volume" :: held 0.737s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:18:59 devstack sudo[109680]: pam_unix(sudo:session): session closed for user root Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683" returned: 0 in 0.433s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:59 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 1G Aug 26 00:18:59 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Created reservations ['e6070fcc-084c-4190-94a2-61c5df1b0381', '8526adfc-e6c3-4ad3-9f18-f34b56c0e91f', '3b24efdb-ea07-4cdb-8602-6de00e67be71', '09392458-eff9-42bd-a351-6c2673a70233'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:18:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:18:59 devstack sudo[109723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:18:59 devstack sudo[109723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:00 devstack sudo[109723]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.325s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:19:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Deleted volume successfully. Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81ef8d23-7fc3-438a-a417-77721df44e0a tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-ad5f7b0a-60c0-4f71-a7d3-a2dc9530dd8d-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:00 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 1G" returned: 0 in 0.520s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:00 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:00 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:00 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:00 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 is being set with open permissions: ugo+rw Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:00 devstack sudo[109737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:00 devstack sudo[109737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Flow 'volume_create_manager' (d95966a2-fbf8-4d2c-bbc0-99a7e5b7393f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3b2c27-fd86-4d9f-a5ac-9e9fba257de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a3b2c27-fd86-4d9f-a5ac-9e9fba257de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1115290855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0249eb9-4c41-4a01-9798-3fcddc47a757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19435b1ed4a07a0b331791210b22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:01Z,use_quota=True,user_id='cf1316bc6fa94648a68c99bb52bc0764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c2b82e-cefe-416a-bbcd-f53d5837c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27c2b82e-cefe-416a-bbcd-f53d5837c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bd61b0-de84-4cc2-9835-28898e04bb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74bd61b0-de84-4cc2-9835-28898e04bb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0249eb9-4c41-4a01-9798-3fcddc47a757', 'volume_name': 'volume-f0249eb9-4c41-4a01-9798-3fcddc47a757', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b9ac1-2233-409e-95d0-43bdf1f33507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481b9ac1-2233-409e-95d0-43bdf1f33507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2edac9-a2a3-46c7-9575-3168a0cc0ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Volume f0249eb9-4c41-4a01-9798-3fcddc47a757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0249eb9-4c41-4a01-9798-3fcddc47a757', 'volume_size': 1} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:00 devstack sudo[109737]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:00 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info Aug 26 00:19:00 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:01 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info" returned: 0 in 0.276s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:01 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info is being set with open permissions: ugo+rw Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:01 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info Aug 26 00:19:01 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:01 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.info" returned: 0 in 0.236s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.667s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1115290855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0249eb9-4c41-4a01-9798-3fcddc47a757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbc19435b1ed4a07a0b331791210b22d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:01Z,use_quota=True,user_id='cf1316bc6fa94648a68c99bb52bc0764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Creating volume f0249eb9-4c41-4a01-9798-3fcddc47a757 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:19:01 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:01 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 1073741824 Aug 26 00:19:01 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-62cd29da-13b0-4694-aaf6-79cb840bb7e3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Create snapshot completed successfully Aug 26 00:19:01 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 1073741824" returned: 0 in 0.426s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:01 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 Aug 26 00:19:01 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:02 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2edac9-a2a3-46c7-9575-3168a0cc0ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0249eb9-4c41-4a01-9798-3fcddc47a757', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e386845-3c5a-40e0-a5bc-997758137a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Volume volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 (f0249eb9-4c41-4a01-9798-3fcddc47a757): created successfully Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e386845-3c5a-40e0-a5bc-997758137a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Flow 'volume_create_manager' (d95966a2-fbf8-4d2c-bbc0-99a7e5b7393f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d801942a-5322-43c6-8c00-f8ed4315f3d1 tempest-VolumesTransfersV357Test-1126613295 None] Created volume successfully. Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Creating offline snapshot 151844cd-07a4-4d11-9d70-164327ab0495 of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[833711d0-d12a-43bd-a62c-1698af12b21e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:02 devstack sudo[109754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:02 devstack sudo[109754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:02 devstack sudo[109754]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.391s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:02 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 1G Aug 26 00:19:02 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "cinder-f0249eb9-4c41-4a01-9798-3fcddc47a757-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-f0249eb9-4c41-4a01-9798-3fcddc47a757-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "cinder-quobyte-f0249eb9-4c41-4a01-9798-3fcddc47a757" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-quobyte-f0249eb9-4c41-4a01-9798-3fcddc47a757" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[137191ff-0af6-48bf-9a40-d12257daaca6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:03 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 Aug 26 00:19:03 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:03 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 1G" returned: 0 in 0.446s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:03 devstack sudo[109766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:03 devstack sudo[109766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:03 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757" returned: 0 in 0.391s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:03 devstack sudo[109771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757 Aug 26 00:19:03 devstack sudo[109771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:03 devstack sudo[109766]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:03 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 is being set with open permissions: ugo+rw Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:03 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:03 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:03 devstack sudo[109771]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f0249eb9-4c41-4a01-9798-3fcddc47a757" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-quobyte-f0249eb9-4c41-4a01-9798-3fcddc47a757" released by "delete_volume" :: held 0.701s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Created reservations ['4d958b65-29d5-4ceb-a206-d9a3018d104d', 'c501bc1f-fe9e-496c-8142-59d1a93d8d30', 'f1cb499b-16d7-40aa-83e6-153b756330a9', 'a9980be2-c9d2-489e-888a-867643ccbc7d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:03 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:19:03 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:03 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.486s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d18194d1-1c37-433e-b0c5-53994d23df00 tempest-VolumesSnapshotListTestJSON-1596375981 None] Create snapshot completed successfully Aug 26 00:19:04 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:19:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Deleted volume successfully. Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-99ede724-4cc7-4cc3-9eaf-a264ed375ab3 tempest-VolumesTransfersV357Test-1762922189 None] Lock "cinder-f0249eb9-4c41-4a01-9798-3fcddc47a757-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Creating offline snapshot 1327b468-7381-4e2a-abe8-8798ffcfb63d of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b184dc17-e4ae-432f-a581-4e41d677f4f2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:04 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:04 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:05 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:05 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d 1G Aug 26 00:19:05 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:05 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d 1G" returned: 0 in 0.500s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:05 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d Aug 26 00:19:05 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:06 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d" returned: 0 in 0.333s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:06 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d is being set with open permissions: ugo+rw Aug 26 00:19:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:06 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d Aug 26 00:19:06 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:06 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.585s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ffd24e5c-0275-41d4-ae10-4d1a57f9730b tempest-VolumesSnapshotListTestJSON-1596375981 None] Create snapshot completed successfully Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-1327b468-7381-4e2a-abe8-8798ffcfb63d-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-1327b468-7381-4e2a-abe8-8798ffcfb63d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-1327b468-7381-4e2a-abe8-8798ffcfb63d" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-1327b468-7381-4e2a-abe8-8798ffcfb63d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Deleting offline snapshot 1327b468-7381-4e2a-abe8-8798ffcfb63d of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] snapshot_file for this snap is: volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d999962e-e5e8-479a-9045-5df48061b9d7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:07 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d Aug 26 00:19:07 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:08 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d" returned: 0 in 0.371s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d41d24-a6b4-455e-ac35-e291aa5519f7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:08 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:08 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:08 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.369s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:08 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d Aug 26 00:19:08 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:09 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d" returned: 0 in 0.459s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:09 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d Aug 26 00:19:09 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:09 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1327b468-7381-4e2a-abe8-8798ffcfb63d" returned: 0 in 0.267s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-1327b468-7381-4e2a-abe8-8798ffcfb63d" released by "_delete_snapshot" :: held 1.572s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" released by "delete_snapshot" :: held 1.598s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Created reservations ['fde4a9e6-b7c8-4aba-a21a-ab4354e95114', '62cf4d0a-dfb1-46d5-a342-264ff5de9cdb', 'ed0bd8fb-016d-4da5-9b29-878294401eb4', '6bc041f7-d446-41ed-8282-fbf8568aaaab'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:19:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Delete snapshot completed successfully. Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-429561db-0707-481e-bd05-1dcd1d3ded9d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-1327b468-7381-4e2a-abe8-8798ffcfb63d-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-151844cd-07a4-4d11-9d70-164327ab0495-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-151844cd-07a4-4d11-9d70-164327ab0495-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-151844cd-07a4-4d11-9d70-164327ab0495" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-151844cd-07a4-4d11-9d70-164327ab0495" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Deleting offline snapshot 151844cd-07a4-4d11-9d70-164327ab0495 of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] snapshot_file for this snap is: volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ee526c-fb99-4bcd-89fb-6fe68c275a3b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:10 devstack sudo[109827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:10 devstack sudo[109827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:10 devstack sudo[109827]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.396s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[783e8ba2-d708-4e16-b2ec-f38a8b1f4923]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:10 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:10 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:10 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:10 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:10 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:11 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.393s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:11 devstack sudo[109842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495 Aug 26 00:19:11 devstack sudo[109842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:11 devstack sudo[109842]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.151844cd-07a4-4d11-9d70-164327ab0495" returned: 0 in 0.276s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-151844cd-07a4-4d11-9d70-164327ab0495" released by "_delete_snapshot" :: held 1.552s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" released by "delete_snapshot" :: held 1.578s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Created reservations ['3bfeb08e-2a33-4173-bd10-638213364c77', '2893e639-6cbd-43cc-b639-93cd9a569a68', '04f47bc1-b031-4ec1-958e-249960ae4a8a', 'e08ff0c6-f61d-4789-aaf7-06a20394ffef'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:19:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Delete snapshot completed successfully. Aug 26 00:19:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d9b749b8-522c-47fd-8bf3-28943bb245d6 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-151844cd-07a4-4d11-9d70-164327ab0495-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-1647b49a-97a9-4dc7-a8c9-1ea414cf6598-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-1647b49a-97a9-4dc7-a8c9-1ea414cf6598-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-1647b49a-97a9-4dc7-a8c9-1ea414cf6598" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-1647b49a-97a9-4dc7-a8c9-1ea414cf6598" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Deleting offline snapshot 1647b49a-97a9-4dc7-a8c9-1ea414cf6598 of volume 3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] snapshot_file for this snap is: volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e501a0a-013c-4fe6-b93a-316b67d0ef9b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:12 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:12 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:12 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3492097e-3d8d-41f1-b499-382224ef5683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[37687e87-3b8b-43a5-8579-c1298a57a2cd]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:12 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 Aug 26 00:19:12 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:12 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:12 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:12 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:13 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:13 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598 Aug 26 00:19:13 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:13 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683.1647b49a-97a9-4dc7-a8c9-1ea414cf6598" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-1647b49a-97a9-4dc7-a8c9-1ea414cf6598" released by "_delete_snapshot" :: held 1.522s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" released by "delete_snapshot" :: held 1.546s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Created reservations ['ccb5e7dc-9a5c-4f0a-83c0-e0badbadcdd3', '47e8911d-24c0-412b-82a5-7db0763463b5', '049340d2-c4e8-4529-90e6-e9c5306e6a3e', 'b0fbdaa5-e951-454f-b6e1-f8afe1bfb1ae'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:19:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Delete snapshot completed successfully. Aug 26 00:19:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8e15d25b-6fa6-4154-ba2e-f0ea61f9acf3 tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-1647b49a-97a9-4dc7-a8c9-1ea414cf6598-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-3492097e-3d8d-41f1-b499-382224ef5683-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-3492097e-3d8d-41f1-b499-382224ef5683-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e78530-c690-4fab-b68b-a6b39f27d696]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:14 devstack sudo[109863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 Aug 26 00:19:14 devstack sudo[109863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:14 devstack sudo[109863]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683" returned: 0 in 0.396s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:14 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683 Aug 26 00:19:14 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:15 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3492097e-3d8d-41f1-b499-382224ef5683" returned: 0 in 0.267s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-quobyte-3492097e-3d8d-41f1-b499-382224ef5683" released by "delete_volume" :: held 0.747s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Created reservations ['8960043d-70b4-4c99-9d07-bcc04b01ae7c', 'f1aaf3c8-b566-4c07-aa41-6a8a03c22d44', 'b2bad8df-875c-437b-b123-5d8a11d0ae80', 'ff33f35a-fb4c-4aa7-ba7d-587cdc4eee1a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:15 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:19:15 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:15 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.326s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:19:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Deleted volume successfully. Aug 26 00:19:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c71fa2c2-9782-43d6-aa79-4c7849c7359d tempest-VolumesSnapshotListTestJSON-1596375981 None] Lock "cinder-3492097e-3d8d-41f1-b499-382224ef5683-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Flow 'volume_create_manager' (d44b34d2-0f69-4d71-89c2-edbb632d4372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e294233-02eb-477d-a67d-ec87939d8ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e294233-02eb-477d-a67d-ec87939d8ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-12635785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8ee2a6-875e-4996-a436-4e5b7bef1274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953bb56f8936438d9804a9241c9439ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:18Z,use_quota=True,user_id='4979ef649e36458682e4ce4b4f495b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fbdf7c-f41e-4751-abc4-88523c25a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fbdf7c-f41e-4751-abc4-88523c25a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c3f20b-b899-4a3e-bb84-124ee351acd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c3f20b-b899-4a3e-bb84-124ee351acd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8ee2a6-875e-4996-a436-4e5b7bef1274', 'volume_name': 'volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccf5355-1769-4b47-aa33-318e87cdef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ccf5355-1769-4b47-aa33-318e87cdef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598c3ca9-16d7-45db-a674-ea8f0d1ae932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274', 'volume_size': 1} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-12635785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8ee2a6-875e-4996-a436-4e5b7bef1274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='953bb56f8936438d9804a9241c9439ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:18Z,use_quota=True,user_id='4979ef649e36458682e4ce4b4f495b9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Creating volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:19:18 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:18 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 1073741824 Aug 26 00:19:18 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:18 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 1073741824" returned: 0 in 0.463s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:18 devstack sudo[109881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:19:18 devstack sudo[109881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:19 devstack sudo[109881]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (598c3ca9-16d7-45db-a674-ea8f0d1ae932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885bc508-e378-443c-9b47-3ea20a664cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Volume volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 (4b8ee2a6-875e-4996-a436-4e5b7bef1274): created successfully Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885bc508-e378-443c-9b47-3ea20a664cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Flow 'volume_create_manager' (d44b34d2-0f69-4d71-89c2-edbb632d4372) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-985fb937-c709-437c-a526-5140d24c0255 tempest-VolumesActionsTest-1103148780 None] Created volume successfully. Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=133,cinder:DELETE=13,cinder:SELECT=109,cinder:INSERT=37 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=108,cinder:UPDATE=142,cinder:INSERT=44,cinder:DELETE=11 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de25692a-2853-430e-946c-cbdbd3190268 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" by "attach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de25692a-2853-430e-946c-cbdbd3190268 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" acquired by "attach_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-de25692a-2853-430e-946c-cbdbd3190268 tempest-VolumesActionsTest-1103148780 None] Attaching volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274 to instance e2266365-a9d2-406a-9857-bb298b94ab32 at mountpoint /dev/vdb on host None. Aug 26 00:19:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-de25692a-2853-430e-946c-cbdbd3190268 tempest-VolumesActionsTest-1103148780 None] Attach volume completed successfully. Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de25692a-2853-430e-946c-cbdbd3190268 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" released by "attach_volume" :: held 0.156s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-179ab49a-ae63-4c56-b8e2-46a46aa76ffa tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" by "detach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-179ab49a-ae63-4c56-b8e2-46a46aa76ffa tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-179ab49a-ae63-4c56-b8e2-46a46aa76ffa tempest-VolumesActionsTest-1103148780 None] Detaching volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274 from instance e2266365-a9d2-406a-9857-bb298b94ab32. Aug 26 00:19:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-179ab49a-ae63-4c56-b8e2-46a46aa76ffa tempest-VolumesActionsTest-1103148780 None] Detach volume completed successfully. Aug 26 00:19:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-179ab49a-ae63-4c56-b8e2-46a46aa76ffa tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:39 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:19:39 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:INSERT=1,cinder:SELECT=6,cinder:UPDATE=4 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1804b9d5-28ab-40c9-8dab-d29ee44efee8 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" by "attach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1804b9d5-28ab-40c9-8dab-d29ee44efee8 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" acquired by "attach_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1804b9d5-28ab-40c9-8dab-d29ee44efee8 tempest-VolumesActionsTest-1103148780 None] Attaching volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274 to instance e36316cc-7c8a-4fa8-b902-b33d988a5df0 at mountpoint /dev/vdb on host None. Aug 26 00:19:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1804b9d5-28ab-40c9-8dab-d29ee44efee8 tempest-VolumesActionsTest-1103148780 None] Attach volume completed successfully. Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1804b9d5-28ab-40c9-8dab-d29ee44efee8 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274" released by "attach_volume" :: held 0.127s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3cbf8f0-845b-4dcc-861c-57666412ef14 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" by "detach_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3cbf8f0-845b-4dcc-861c-57666412ef14 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:19:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a3cbf8f0-845b-4dcc-861c-57666412ef14 tempest-VolumesActionsTest-1103148780 None] Detaching volume 4b8ee2a6-875e-4996-a436-4e5b7bef1274 from instance e36316cc-7c8a-4fa8-b902-b33d988a5df0. Aug 26 00:19:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a3cbf8f0-845b-4dcc-861c-57666412ef14 tempest-VolumesActionsTest-1103148780 None] Detach volume completed successfully. Aug 26 00:19:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3cbf8f0-845b-4dcc-861c-57666412ef14 tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-detach_volume" released by "detach_volume" :: held 0.105s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2473d7af-ba53-4cb9-a67c-e3c95d471abc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:46 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:19:46 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:46 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.410s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:46 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:19:46 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d52987-106b-4b45-b50d-7b9e64e09a63]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:46 devstack sudo[110152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:19:46 devstack sudo[110152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:46 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:19:46 devstack sudo[110152]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.387s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.6ab98f02-f090-438a-80e7-af95d1d970636bu_wm0y.img {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:47 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.6ab98f02-f090-438a-80e7-af95d1d970636bu_wm0y.img Aug 26 00:19:47 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:51 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.6ab98f02-f090-438a-80e7-af95d1d970636bu_wm0y.img" returned: 0 in 4.457s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa38c926-0b1f-4c44-89f7-55a8b21f9275]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:51 devstack sudo[110172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:19:51 devstack sudo[110172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:51 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:19:52 devstack sudo[110172]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.594s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274, size 1024.00 MB, duration 4.46 sec, destination /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.6ab98f02-f090-438a-80e7-af95d1d970636bu_wm0y.img {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:19:52 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Converted 1024.00 MB image at 229.67 MB/s Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] 6ab98f02-f090-438a-80e7-af95d1d97063 was raw, no need to convert to raw {{(pid=94433) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (b9d3425e-3bd8-4718-a705-9c636c41654a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500f47b0-4c5d-4b64-8a83-68667417fe7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500f47b0-4c5d-4b64-8a83-68667417fe7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2036488342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c4dc0-35fd-4f7b-881e-46609d70ae3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:52Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bfef216-a4af-463a-98d8-39912a0228a9),volume_type_id=2bfef216-a4af-463a-98d8-39912a0228a9)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b72589-758d-445b-a362-4821458c3c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12b72589-758d-445b-a362-4821458c3c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614a453-98df-4625-b567-43186eff9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d614a453-98df-4625-b567-43186eff9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132c4dc0-35fd-4f7b-881e-46609d70ae3a', 'volume_name': 'volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a8292e-fc9d-4a1e-95d4-8ea08580cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a8292e-fc9d-4a1e-95d4-8ea08580cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950f898-1106-47d0-a12d-99d469f0dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume 132c4dc0-35fd-4f7b-881e-46609d70ae3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a', 'volume_size': 1} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (d56fd1fc-b0b2-4c66-a905-06988d3f508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77b6dd6-9a12-48b2-8ec8-6add36c64ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b77b6dd6-9a12-48b2-8ec8-6add36c64ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-271162756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274f41e4-e7c1-4700-ba20-e9eca6e5cd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:53Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25dc769-f986-4055-95d7-5eb5441459f4),volume_type_id=f25dc769-f986-4055-95d7-5eb5441459f4)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93688805-4a68-4d28-96b2-b5073052181b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93688805-4a68-4d28-96b2-b5073052181b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d2768f-a4a8-4b72-902a-827b220e5ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43d2768f-a4a8-4b72-902a-827b220e5ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '274f41e4-e7c1-4700-ba20-e9eca6e5cd1b', 'volume_name': 'volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971ba54-ac2c-40ec-a044-9510d582e7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2971ba54-ac2c-40ec-a044-9510d582e7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14c3bcb-9077-4d07-a3e8-5bed28b06bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume 274f41e4-e7c1-4700-ba20-e9eca6e5cd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b', 'volume_size': 1} Aug 26 00:19:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (45ed337b-566d-49de-b9cf-d2e9421759ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be673ec8-7977-4b90-82d1-bb458f728249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be673ec8-7977-4b90-82d1-bb458f728249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1912972772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d79209-896e-438f-8fc3-9231ae38d1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:53Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f38ddf-1b6c-4d56-957f-bc1831624dba),volume_type_id=09f38ddf-1b6c-4d56-957f-bc1831624dba)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a319300-fe64-45d5-be7a-ae31a63b8f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a319300-fe64-45d5-be7a-ae31a63b8f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2289a2-9147-46a4-a33d-5b294935031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c2289a2-9147-46a4-a33d-5b294935031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39d79209-896e-438f-8fc3-9231ae38d1ad', 'volume_name': 'volume-39d79209-896e-438f-8fc3-9231ae38d1ad', 'volume_size': 1, 'image_id': '23e61798-805d-4231-8055-b5f4e1028889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--243254715', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10b4bf8a4e6b472db823522c612d4da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e61798-805d-4231-8055-b5f4e1028889', 'created_at': datetime.datetime(2026, 8, 25, 22, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 19, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e61798-805d-4231-8055-b5f4e1028889/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0027612-1fd5-47bb-ac2b-42dd23a79813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0027612-1fd5-47bb-ac2b-42dd23a79813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689774d2-0272-46cb-a705-3336fc136563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:19:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume 39d79209-896e-438f-8fc3-9231ae38d1ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39d79209-896e-438f-8fc3-9231ae38d1ad', 'volume_size': 1, 'image_id': '23e61798-805d-4231-8055-b5f4e1028889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--243254715', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10b4bf8a4e6b472db823522c612d4da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e61798-805d-4231-8055-b5f4e1028889', 'created_at': datetime.datetime(2026, 8, 25, 22, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 19, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e61798-805d-4231-8055-b5f4e1028889/file', 'properties': {}}, 'image_service': } Aug 26 00:19:53 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Trying to clone 39d79209-896e-438f-8fc3-9231ae38d1ad from image 23e61798-805d-4231-8055-b5f4e1028889 at location (None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:19:57 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD, size 20.69 MB, duration 3.83 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:19:57 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Image download 20.69 MB at 5.41 MB/s Aug 26 00:19:57 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f49951-7963-4921-8c0b-82f7d9a81fcb]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:57 devstack sudo[110180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD Aug 26 00:19:57 devstack sudo[110180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:58 devstack sudo[110180]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Temporary image 23e61798-805d-4231-8055-b5f4e1028889 is fetched for user aec3db05d48641a5ae292b7cc4e31194. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[646661e8-6dc2-43a6-ac61-79a75f7d46ce]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:19:58 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD Aug 26 00:19:58 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:19:58 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:19:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:03 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:INSERT=2,cinder:SELECT=10,cinder:UPDATE=5 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:20:08 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.207s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Uploaded volume to glance image-id: 6ab98f02-f090-438a-80e7-af95d1d97063. {{(pid=94433) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.975s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2036488342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132c4dc0-35fd-4f7b-881e-46609d70ae3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:52Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2bfef216-a4af-463a-98d8-39912a0228a9),volume_type_id=2bfef216-a4af-463a-98d8-39912a0228a9)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Creating volume 132c4dc0-35fd-4f7b-881e-46609d70ae3a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:20:11 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:11 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a 1073741824 Aug 26 00:20:11 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-451e5f32-ea44-4b21-8d93-2ffc1ea0fc05 tempest-VolumesActionsTest-1103148780 None] Copy volume to image completed successfully. Aug 26 00:20:11 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a 1073741824" returned: 0 in 0.472s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:11 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a Aug 26 00:20:11 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:12 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a" returned: 0 in 0.241s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.320s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-271162756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=274f41e4-e7c1-4700-ba20-e9eca6e5cd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:53Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f25dc769-f986-4055-95d7-5eb5441459f4),volume_type_id=f25dc769-f986-4055-95d7-5eb5441459f4)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Creating volume 274f41e4-e7c1-4700-ba20-e9eca6e5cd1b {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2950f898-1106-47d0-a12d-99d469f0dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:12 devstack sudo[110244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b 1073741824 Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ec25b7-dc14-4061-adc7-27be06aba39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:12 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a (132c4dc0-35fd-4f7b-881e-46609d70ae3a): created successfully Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ec25b7-dc14-4061-adc7-27be06aba39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (b9d3425e-3bd8-4718-a705-9c636c41654a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-01b62ce9-48b0-4344-9246-5015eefe117c tempest-TestInstancesWithCinderVolumes-1758414419 None] Created volume successfully. Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:12 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b 1073741824" returned: 0 in 0.475s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:12 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b Aug 26 00:20:12 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:12 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.419s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1912972772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d79209-896e-438f-8fc3-9231ae38d1ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10b4bf8a4e6b472db823522c612d4da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:19:53Z,use_quota=True,user_id='aec3db05d48641a5ae292b7cc4e31194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09f38ddf-1b6c-4d56-957f-bc1831624dba),volume_type_id=09f38ddf-1b6c-4d56-957f-bc1831624dba)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Creating volume 39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14c3bcb-9077-4d07-a3e8-5bed28b06bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:12 devstack sudo[110253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1073741824 Aug 26 00:20:12 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6ea4e-f5c0-4110-adcf-77cfb4d07010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b (274f41e4-e7c1-4700-ba20-e9eca6e5cd1b): created successfully Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a6ea4e-f5c0-4110-adcf-77cfb4d07010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:12 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (d56fd1fc-b0b2-4c66-a905-06988d3f508e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fe9777e8-672f-4c21-a551-ed749e732ba5 tempest-TestInstancesWithCinderVolumes-1758414419 None] Created volume successfully. Aug 26 00:20:13 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1073741824" returned: 0 in 0.411s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:13 devstack sudo[110258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad Aug 26 00:20:13 devstack sudo[110258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:13 devstack sudo[110258]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.285s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c59a40d-4fc7-4167-96dd-f877934a598d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Attempting download of 23e61798-805d-4231-8055-b5f4e1028889 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}])) to volume 39d79209-896e-438f-8fc3-9231ae38d1ad. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb40df28-f4ae-4438-a9ad-b561f2d21f2b]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:13 devstack sudo[110261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:20:13 devstack sudo[110261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:13 devstack sudo[110262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d Aug 26 00:20:13 devstack sudo[110262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:13 devstack sudo[110261]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a549ea2-dcf1-467c-afaa-9120f365ebee]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:14 devstack sudo[110262]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d" returned: 0 in 0.341s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:14 devstack sudo[110270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:20:14 devstack sudo[110270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:14 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d Aug 26 00:20:14 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:14 devstack sudo[110270]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.362s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:14 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d" returned: 1 in 0.341s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23e61798-805d-4231-8055-b5f4e1028889_x31mwn1d' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966d2ef-79a1-40c1-9c10-3593596f6064]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:14 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img Aug 26 00:20:14 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:14 devstack sudo[110280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD Aug 26 00:20:14 devstack sudo[110280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:14 devstack sudo[110280]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] 23e61798-805d-4231-8055-b5f4e1028889 was qcow2, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:20:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:14 devstack sudo[110296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad Aug 26 00:20:14 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:18 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad" returned: 0 in 3.627s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23e61798-805d-4231-8055-b5f4e1028889_z5uhq5fbdevstack@QuobyteHD, size 112.00 MB, duration 3.63 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:20:18 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Converted 112.00 MB image at 30.83 MB/s Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:18 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1G Aug 26 00:20:18 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:18 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img" returned: 0 in 4.439s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca87c67-8fcb-4564-92f4-2ba27567f5a1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:18 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:20:18 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:18 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad 1G" returned: 0 in 0.516s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Downloaded image 23e61798-805d-4231-8055-b5f4e1028889 ((None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}])) to volume 39d79209-896e-438f-8fc3-9231ae38d1ad successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Temporary image 23e61798-805d-4231-8055-b5f4e1028889 for user aec3db05d48641a5ae292b7cc4e31194 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Marking volume 39d79209-896e-438f-8fc3-9231ae38d1ad as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Copying metadata from image 23e61798-805d-4231-8055-b5f4e1028889 to 39d79209-896e-438f-8fc3-9231ae38d1ad. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:20:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Creating volume glance metadata for volume 39d79209-896e-438f-8fc3-9231ae38d1ad backed by image 23e61798-805d-4231-8055-b5f4e1028889 with: {'image_id': '23e61798-805d-4231-8055-b5f4e1028889', 'image_name': 'tempest-scenario-img--243254715', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689774d2-0272-46cb-a705-3336fc136563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d79209-896e-438f-8fc3-9231ae38d1ad', 'volume_size': 1, 'image_id': '23e61798-805d-4231-8055-b5f4e1028889', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23e61798-805d-4231-8055-b5f4e1028889', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--243254715', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '10b4bf8a4e6b472db823522c612d4da9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23e61798-805d-4231-8055-b5f4e1028889', 'created_at': datetime.datetime(2026, 8, 25, 22, 19, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 19, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23e61798-805d-4231-8055-b5f4e1028889/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7179599-e491-4e2d-b296-6779f7e40a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Volume volume-39d79209-896e-438f-8fc3-9231ae38d1ad (39d79209-896e-438f-8fc3-9231ae38d1ad): created successfully Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7179599-e491-4e2d-b296-6779f7e40a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Flow 'volume_create_manager' (45ed337b-566d-49de-b9cf-d2e9421759ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fd382fb4-d6b5-41f1-81dd-37df89d8c563 tempest-TestInstancesWithCinderVolumes-1758414419 None] Created volume successfully. Aug 26 00:20:19 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.553s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:20:19 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Converted 1024.00 MB image at 230.64 MB/s Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] fa519478-bc7a-4614-839b-20da23bff419 was raw, converting to qcow2 {{(pid=94433) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bda25a3-5383-48b3-93d9-d3a5979d716d]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:19 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img Aug 26 00:20:19 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:19 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img" returned: 0 in 0.315s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:19 devstack sudo[110321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img Aug 26 00:20:19 devstack sudo[110321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:20 devstack sudo[110321]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img" returned: 1 in 0.326s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:20 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2 Aug 26 00:20:20 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:20 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2" returned: 0 in 0.269s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Image conversion details: src /opt/stack/data/cinder/conversion/4b8ee2a6-875e-4996-a436-4e5b7bef1274.temp_image.fa519478-bc7a-4614-839b-20da23bff4194q51oe3a.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:20:20 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef26128e-a1bc-4196-b75b-e00f5e6c4413]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:20 devstack sudo[110332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2 Aug 26 00:20:20 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:20 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4siv3jj2" returned: 0 in 0.325s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.444s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Uploaded volume to glance image-id: fa519478-bc7a-4614-839b-20da23bff419. {{(pid=94433) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 00:20:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1b3849b7-af59-4973-bcc2-ab9b6cbc0e56 tempest-VolumesActionsTest-1103148780 None] Copy volume to image completed successfully. Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-3d528541-c87c-41c3-9c80-cda4207db603 req-11262b97-d222-429b-bbac-aa8e5529bcfa tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-3d528541-c87c-41c3-9c80-cda4207db603 req-11262b97-d222-429b-bbac-aa8e5529bcfa tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-3d528541-c87c-41c3-9c80-cda4207db603 req-11262b97-d222-429b-bbac-aa8e5529bcfa tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-3d528541-c87c-41c3-9c80-cda4207db603 req-11262b97-d222-429b-bbac-aa8e5529bcfa tempest-TestInstancesWithCinderVolumes-1758414419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-39d79209-896e-438f-8fc3-9231ae38d1ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d2bd3e3-e246-42aa-8e81-e2ca2e8169a2', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:20:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-3d528541-c87c-41c3-9c80-cda4207db603 req-11262b97-d222-429b-bbac-aa8e5529bcfa tempest-TestInstancesWithCinderVolumes-1758414419 None] attachment_update completed successfully. Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Acquiring lock "cinder-quobyte-4b8ee2a6-875e-4996-a436-4e5b7bef1274" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "cinder-quobyte-4b8ee2a6-875e-4996-a436-4e5b7bef1274" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eaa70c-b0df-4da7-97e4-0933e5a6324e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:23 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:20:23 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:24 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:24 devstack sudo[110355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274 Aug 26 00:20:24 devstack sudo[110355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:24 devstack sudo[110355]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-4b8ee2a6-875e-4996-a436-4e5b7bef1274" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "cinder-quobyte-4b8ee2a6-875e-4996-a436-4e5b7bef1274" released by "delete_volume" :: held 0.734s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Created reservations ['15868f0f-73a0-4bfc-838a-74f9c2137c47', '5235f2c2-8c8c-45d2-91bc-abc79aebefc2', '18947c8d-db0c-4c6e-9333-1196bce85fad', '421537af-7852-461c-a357-fa1d0406164a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:24 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:20:24 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:24 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:20:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Deleted volume successfully. Aug 26 00:20:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-488f904e-2403-4cd1-8ee3-66482dab750c tempest-VolumesActionsTest-1103148780 None] Lock "cinder-4b8ee2a6-875e-4996-a436-4e5b7bef1274-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Flow 'volume_create_manager' (0a786b81-a4c1-4a88-b6a2-61125d947332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346bce89-f01b-45b7-8b23-3c991f25d59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346bce89-f01b-45b7-8b23-3c991f25d59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1087529556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26899984-1da8-4040-9bc9-f107bd1e409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea798d2c3a242109c494bfd3114883c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:20:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:20:33Z,use_quota=True,user_id='32027f77328b4cf0a45b64300e3bc182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158efb9c-91af-4981-850e-60f92ff20501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158efb9c-91af-4981-850e-60f92ff20501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d670f99-6241-4548-9a27-c67ba9168254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d670f99-6241-4548-9a27-c67ba9168254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26899984-1da8-4040-9bc9-f107bd1e409b', 'volume_name': 'volume-26899984-1da8-4040-9bc9-f107bd1e409b', 'volume_size': 2}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241d4d1-bbd0-4975-bf57-dcb0abb4be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e241d4d1-bbd0-4975-bf57-dcb0abb4be7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd152556-705c-4dd9-93ba-6953d2f8388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Volume 26899984-1da8-4040-9bc9-f107bd1e409b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26899984-1da8-4040-9bc9-f107bd1e409b', 'volume_size': 2} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1087529556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26899984-1da8-4040-9bc9-f107bd1e409b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea798d2c3a242109c494bfd3114883c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:20:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:20:33Z,use_quota=True,user_id='32027f77328b4cf0a45b64300e3bc182',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Creating volume 26899984-1da8-4040-9bc9-f107bd1e409b {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:20:33 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:20:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b 2147483648 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:33 devstack sudo[110831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b 2147483648 Aug 26 00:20:33 devstack sudo[110831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:34 devstack sudo[110831]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b 2147483648" returned: 0 in 0.571s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:34 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b Aug 26 00:20:34 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:34 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b" returned: 0 in 0.306s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd152556-705c-4dd9-93ba-6953d2f8388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26899984-1da8-4040-9bc9-f107bd1e409b', 'volume_size': 2}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db42ba90-ac27-4708-9b2b-a13c71a256bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Volume volume-26899984-1da8-4040-9bc9-f107bd1e409b (26899984-1da8-4040-9bc9-f107bd1e409b): created successfully Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db42ba90-ac27-4708-9b2b-a13c71a256bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Flow 'volume_create_manager' (0a786b81-a4c1-4a88-b6a2-61125d947332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-acf88020-e4c1-45dd-b7ec-35c63983f2fa tempest-VolumesCloneNegativeTest-1109523945 None] Created volume successfully. Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Acquiring lock "cinder-26899984-1da8-4040-9bc9-f107bd1e409b-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "cinder-26899984-1da8-4040-9bc9-f107bd1e409b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Acquiring lock "cinder-quobyte-26899984-1da8-4040-9bc9-f107bd1e409b" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "cinder-quobyte-26899984-1da8-4040-9bc9-f107bd1e409b" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a51ff24-e3cb-4061-b9af-e58d7625459b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:36 devstack sudo[110841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b Aug 26 00:20:36 devstack sudo[110841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:36 devstack sudo[110841]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:36 devstack sudo[110846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b Aug 26 00:20:36 devstack sudo[110846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:36 devstack sudo[110846]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-26899984-1da8-4040-9bc9-f107bd1e409b" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "cinder-quobyte-26899984-1da8-4040-9bc9-f107bd1e409b" released by "delete_volume" :: held 0.654s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Created reservations ['0a745d54-15c9-42cc-a90d-2fa7e21ae1ea', 'a0a571a4-e2de-489d-90b4-8c8b375843a2', 'f1da9cb4-df64-4936-9185-a6d3d0e366d9', '51fe4a1e-5314-4e46-a6b9-15d1ba52055e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:36 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:20:36 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:37 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:37 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:20:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Deleted volume successfully. Aug 26 00:20:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-21c81d0e-6d01-4e91-8a5c-74155204c168 tempest-VolumesCloneNegativeTest-1109523945 None] Lock "cinder-26899984-1da8-4040-9bc9-f107bd1e409b-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Flow 'volume_create_manager' (f0096c4e-3f6f-48ae-a184-3f92976130be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd1224b-6afb-4829-9665-7ce3a4a53293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd1224b-6afb-4829-9665-7ce3a4a53293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1412389581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40119420-ac90-4f50-9ee0-21ee6cc64764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a302ccc38a459c91fa999579e6b2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:20:40Z,use_quota=True,user_id='6857396564474ef09087b71e2835393e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0eb9d9-243f-4c36-b69c-7d1da2f310c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0eb9d9-243f-4c36-b69c-7d1da2f310c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27abaa-6189-47bd-96b3-e2b6e700efd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d27abaa-6189-47bd-96b3-e2b6e700efd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40119420-ac90-4f50-9ee0-21ee6cc64764', 'volume_name': 'volume-40119420-ac90-4f50-9ee0-21ee6cc64764', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a090148b-c17c-4ae1-893c-8ccb543aeabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a090148b-c17c-4ae1-893c-8ccb543aeabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb24db-2cbe-4fb0-aee4-a6f48a81c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Volume 40119420-ac90-4f50-9ee0-21ee6cc64764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40119420-ac90-4f50-9ee0-21ee6cc64764', 'volume_size': 1} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1412389581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40119420-ac90-4f50-9ee0-21ee6cc64764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a302ccc38a459c91fa999579e6b2dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:20:40Z,use_quota=True,user_id='6857396564474ef09087b71e2835393e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Creating volume 40119420-ac90-4f50-9ee0-21ee6cc64764 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:20:39 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:20:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:39 devstack sudo[110854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 1073741824 Aug 26 00:20:39 devstack sudo[110854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:40 devstack sudo[110854]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 1073741824" returned: 0 in 0.462s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:40 devstack sudo[110859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 Aug 26 00:20:40 devstack sudo[110859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:40 devstack sudo[110859]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53fb24db-2cbe-4fb0-aee4-a6f48a81c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40119420-ac90-4f50-9ee0-21ee6cc64764', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348adbaa-d845-429d-bf50-f6c31b6e13b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:20:40 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Volume volume-40119420-ac90-4f50-9ee0-21ee6cc64764 (40119420-ac90-4f50-9ee0-21ee6cc64764): created successfully Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348adbaa-d845-429d-bf50-f6c31b6e13b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:20:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Flow 'volume_create_manager' (f0096c4e-3f6f-48ae-a184-3f92976130be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:20:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ad6077a5-8230-4ca9-840d-0bbef1b8ad97 tempest-VolumesNegativeTest-847878525 None] Created volume successfully. Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:46 devstack sudo[110959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:20:46 devstack sudo[110959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:46 devstack sudo[110959]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:20:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:20:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=33,cinder:UPDATE=35,cinder:DELETE=3,cinder:INSERT=11 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:20:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=33,cinder:INSERT=10,cinder:DELETE=4,cinder:SELECT=29 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:20:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-2417fd75-d3f8-4c41-8b86-c1c39eec0ebb req-d4dcbe9b-f1cb-4d87-b913-bb4b840bd8bc tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-2417fd75-d3f8-4c41-8b86-c1c39eec0ebb req-d4dcbe9b-f1cb-4d87-b913-bb4b840bd8bc tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-2417fd75-d3f8-4c41-8b86-c1c39eec0ebb req-d4dcbe9b-f1cb-4d87-b913-bb4b840bd8bc tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-2417fd75-d3f8-4c41-8b86-c1c39eec0ebb req-d4dcbe9b-f1cb-4d87-b913-bb4b840bd8bc tempest-TestInstancesWithCinderVolumes-1758414419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98eef937-d4ba-4d43-975b-25398c99113d', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:20:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-2417fd75-d3f8-4c41-8b86-c1c39eec0ebb req-d4dcbe9b-f1cb-4d87-b913-bb4b840bd8bc tempest-TestInstancesWithCinderVolumes-1758414419 None] attachment_update completed successfully. Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Acquiring lock "cinder-40119420-ac90-4f50-9ee0-21ee6cc64764-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "cinder-40119420-ac90-4f50-9ee0-21ee6cc64764-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Acquiring lock "cinder-quobyte-40119420-ac90-4f50-9ee0-21ee6cc64764" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "cinder-quobyte-40119420-ac90-4f50-9ee0-21ee6cc64764" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc45406f-fc29-4fe0-92f6-f741cd9a9d8c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:20:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:57 devstack sudo[111068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 Aug 26 00:20:57 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:58 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:58 devstack sudo[111077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764 Aug 26 00:20:58 devstack sudo[111077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-65a6a933-d526-49dc-816b-02f5b5901aec req-3e5073bd-3510-4a38-a157-87a3bcaaa0c6 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-65a6a933-d526-49dc-816b-02f5b5901aec req-3e5073bd-3510-4a38-a157-87a3bcaaa0c6 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-65a6a933-d526-49dc-816b-02f5b5901aec req-3e5073bd-3510-4a38-a157-87a3bcaaa0c6 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-65a6a933-d526-49dc-816b-02f5b5901aec req-3e5073bd-3510-4a38-a157-87a3bcaaa0c6 tempest-TestInstancesWithCinderVolumes-1758414419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e428a167-8fe0-465d-aa9b-f71bec2c73ea', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:20:58 devstack sudo[111077]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-40119420-ac90-4f50-9ee0-21ee6cc64764" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "cinder-quobyte-40119420-ac90-4f50-9ee0-21ee6cc64764" released by "delete_volume" :: held 0.711s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:20:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-65a6a933-d526-49dc-816b-02f5b5901aec req-3e5073bd-3510-4a38-a157-87a3bcaaa0c6 tempest-TestInstancesWithCinderVolumes-1758414419 None] attachment_update completed successfully. Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Created reservations ['c3e5ebed-1023-4531-af67-631f2edd3496', '269f8db4-6993-4d5d-8b6d-adc562c8d67c', 'eadfc082-c3b6-4a25-aaf4-14b0c5c995b2', '4066549d-bf04-4ee2-a0ba-abed1f1972d0'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:20:58 devstack sudo[111086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:20:58 devstack sudo[111086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:20:58 devstack sudo[111086]: pam_unix(sudo:session): session closed for user root Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:20:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Deleted volume successfully. Aug 26 00:20:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba6def98-4e8e-42f0-a5d8-302ae282e255 tempest-VolumesNegativeTest-847878525 None] Lock "cinder-40119420-ac90-4f50-9ee0-21ee6cc64764-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-86bdec89-55ef-4db2-8e49-9490ef0fc5d1 req-86458534-95b5-40c7-8fe8-247ca27a7ae2 tempest-TestInstancesWithCinderVolumes-1758414419 None] Terminate volume connection completed successfully. Aug 26 00:21:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-86bdec89-55ef-4db2-8e49-9490ef0fc5d1 req-86458534-95b5-40c7-8fe8-247ca27a7ae2 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleting attachment 98eef937-d4ba-4d43-975b-25398c99113d. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:21:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-132c4dc0-35fd-4f7b-881e-46609d70ae3a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-132c4dc0-35fd-4f7b-881e-46609d70ae3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-quobyte-132c4dc0-35fd-4f7b-881e-46609d70ae3a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-132c4dc0-35fd-4f7b-881e-46609d70ae3a" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc12f11f-393e-4724-b1ef-0be7bb5a3275]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:05 devstack sudo[111166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a Aug 26 00:21:05 devstack sudo[111166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:05 devstack sudo[111166]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a" returned: 0 in 0.458s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:05 devstack sudo[111171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a Aug 26 00:21:05 devstack sudo[111171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:05 devstack sudo[111171]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-132c4dc0-35fd-4f7b-881e-46609d70ae3a" returned: 0 in 0.426s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-132c4dc0-35fd-4f7b-881e-46609d70ae3a" released by "delete_volume" :: held 0.932s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:06 devstack cinder-volume[94433]: WARNING cinder.quota [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-258637227-512400364 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-258637227-512400364, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:06 devstack cinder-volume[94433]: WARNING cinder.quota [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-258637227-512400364 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-258637227-512400364, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Created reservations ['544fc804-e69e-4b9a-ab6e-ea59243b7de3', 'be59ed07-fa7d-4294-bd42-fd809656692c', '8ab885e5-f45b-4681-b064-e69bf0d90467', 'fcf50b85-c63d-4c08-9b2d-b6052613316b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:06 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:06 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:06 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleted volume successfully. Aug 26 00:21:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ac82d8ae-f7c7-42da-aa5b-5ded3d9de28c tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-132c4dc0-35fd-4f7b-881e-46609d70ae3a-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-69e9200a-bb11-4c92-8e96-8bf0eef7916d req-1d350f00-f5c5-4bcb-b861-58e707659342 tempest-TestInstancesWithCinderVolumes-1758414419 None] Terminate volume connection completed successfully. Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-69e9200a-bb11-4c92-8e96-8bf0eef7916d req-1d350f00-f5c5-4bcb-b861-58e707659342 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleting attachment e428a167-8fe0-465d-aa9b-f71bec2c73ea. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-quobyte-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf560c0e-fbf9-400c-81e9-46d93ca3e05b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:09 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b Aug 26 00:21:09 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:10 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:10 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b Aug 26 00:21:10 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:10 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b" released by "delete_volume" :: held 0.759s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:10 devstack cinder-volume[94433]: WARNING cinder.quota [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-911846897-616763384 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-911846897-616763384, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:10 devstack cinder-volume[94433]: WARNING cinder.quota [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-911846897-616763384 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-911846897-616763384, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Created reservations ['b61b7da6-597c-4e4f-9819-737f9f77c937', '91da098e-acc2-4910-baf0-29ed4f1a3c14', '05e17d4a-ed2f-4f53-a195-e647562a1870', 'e87155be-9179-4059-8f3a-81d0656a200c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:10 devstack sudo[111218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:10 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:10 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:10 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleted volume successfully. Aug 26 00:21:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc3291f3-79ef-45cd-8b27-2d87c1deb81e tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-274f41e4-e7c1-4700-ba20-e9eca6e5cd1b-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (37f076ac-9422-4f0e-96f9-4618f06698f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad0de78-6968-46e2-8279-606999e254f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad0de78-6968-46e2-8279-606999e254f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-396744716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eada99-5f9e-466d-b36e-5b9d730a3f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:13Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e0851-f301-459e-8505-847e25dde0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b9e0851-f301-459e-8505-847e25dde0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100c225d-b51d-4e6c-aec2-de33652ffa80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100c225d-b51d-4e6c-aec2-de33652ffa80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6eada99-5f9e-466d-b36e-5b9d730a3f12', 'volume_name': 'volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef4631-d660-4eff-b393-18714d6d3180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef4631-d660-4eff-b393-18714d6d3180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff65d78d-6b52-456f-9d48-6eee5f279a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:13 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Volume a6eada99-5f9e-466d-b36e-5b9d730a3f12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12', 'volume_size': 1} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-396744716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6eada99-5f9e-466d-b36e-5b9d730a3f12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:13Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Creating volume a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:13 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:13 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 1073741824 Aug 26 00:21:13 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:13 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 1073741824" returned: 0 in 0.486s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:13 devstack sudo[111255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 Aug 26 00:21:13 devstack sudo[111255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:14 devstack sudo[111255]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12" returned: 0 in 0.295s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff65d78d-6b52-456f-9d48-6eee5f279a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd576fac-7628-4394-b484-333ddd977636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Volume volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 (a6eada99-5f9e-466d-b36e-5b9d730a3f12): created successfully Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd576fac-7628-4394-b484-333ddd977636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (37f076ac-9422-4f0e-96f9-4618f06698f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9fdfa821-2f34-49de-9281-f37411b90a52 tempest-VolumesSnapshotTestJSON-24263590 None] Created volume successfully. Aug 26 00:21:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-8bf0cf83-c96c-40c2-9afd-c3b77cf930fc req-8594de4c-3482-4254-8baa-4882a6cc1a20 tempest-TestInstancesWithCinderVolumes-1758414419 None] Terminate volume connection completed successfully. Aug 26 00:21:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-8bf0cf83-c96c-40c2-9afd-c3b77cf930fc req-8594de4c-3482-4254-8baa-4882a6cc1a20 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleting attachment 4d2bd3e3-e246-42aa-8e81-e2ca2e8169a2. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Creating offline snapshot 30878c33-8296-41d7-91a6-ab7822dd0d8b of volume a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679f3e6-ecde-4f2a-a431-bbfef47ed270]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-39d79209-896e-438f-8fc3-9231ae38d1ad-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-39d79209-896e-438f-8fc3-9231ae38d1ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "cinder-quobyte-39d79209-896e-438f-8fc3-9231ae38d1ad" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-39d79209-896e-438f-8fc3-9231ae38d1ad" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:15 devstack sudo[111260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 Aug 26 00:21:15 devstack sudo[111260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[974245c1-74fc-46ca-b10e-0e95d3f59dfe]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:15 devstack sudo[111262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad Aug 26 00:21:15 devstack sudo[111262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:15 devstack sudo[111260]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:15 devstack sudo[111267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b 1G Aug 26 00:21:15 devstack sudo[111267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:15 devstack sudo[111262]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:15 devstack sudo[111272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad Aug 26 00:21:15 devstack sudo[111272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:16 devstack sudo[111267]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b 1G" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:16 devstack sudo[111272]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-39d79209-896e-438f-8fc3-9231ae38d1ad" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-quobyte-39d79209-896e-438f-8fc3-9231ae38d1ad" released by "delete_volume" :: held 0.686s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:16 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b Aug 26 00:21:16 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:16 devstack cinder-volume[94433]: WARNING cinder.quota [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406220640-1804831904 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406220640-1804831904, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:16 devstack cinder-volume[94433]: WARNING cinder.quota [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406220640-1804831904 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1406220640-1804831904, it is now deprecated. Please use the default quota class for default quota. Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Created reservations ['af1d351c-7535-4cbf-b5b0-9e12b40a669f', '2291aae2-d502-4ee2-91a9-0eb8e712fc1b', '01a02dde-ef56-4d7e-a0e3-e833ba2ea23e', 'b4459454-cfe7-4f84-9b80-184f0dc99b77'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:16 devstack sudo[111280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:16 devstack sudo[111280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:16 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b" returned: 0 in 0.291s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:16 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b is being set with open permissions: ugo+rw Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:16 devstack sudo[111285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b Aug 26 00:21:16 devstack sudo[111285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:16 devstack sudo[111280]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Deleted volume successfully. Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1095b21f-07d3-483f-9b89-ba25dc7a5451 tempest-TestInstancesWithCinderVolumes-1758414419 None] Lock "cinder-39d79209-896e-438f-8fc3-9231ae38d1ad-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:16 devstack sudo[111285]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:16 devstack sudo[111289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info Aug 26 00:21:16 devstack sudo[111289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:17 devstack sudo[111289]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info" returned: 0 in 0.266s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:17 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info is being set with open permissions: ugo+rw Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:17 devstack sudo[111292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info Aug 26 00:21:17 devstack sudo[111292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:17 devstack sudo[111292]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.info" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f12abf7f-87c6-40c3-845b-b36e09880823 tempest-VolumesSnapshotTestJSON-24263590 None] Create snapshot completed successfully Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-30878c33-8296-41d7-91a6-ab7822dd0d8b-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-30878c33-8296-41d7-91a6-ab7822dd0d8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-30878c33-8296-41d7-91a6-ab7822dd0d8b" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-30878c33-8296-41d7-91a6-ab7822dd0d8b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Deleting offline snapshot 30878c33-8296-41d7-91a6-ab7822dd0d8b of volume a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] snapshot_file for this snap is: volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[38881834-094b-4c04-9b01-46d01b5b94b4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:17 devstack sudo[111296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b Aug 26 00:21:17 devstack sudo[111296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:18 devstack sudo[111296]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fffac-dd58-4dc5-9812-1c009a7a02be]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:18 devstack sudo[111301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 Aug 26 00:21:18 devstack sudo[111301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:18 devstack sudo[111301]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12" returned: 0 in 0.362s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:18 devstack sudo[111306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b Aug 26 00:21:18 devstack sudo[111306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:18 devstack sudo[111306]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:18 devstack sudo[111312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b Aug 26 00:21:18 devstack sudo[111312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:19 devstack sudo[111312]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12.30878c33-8296-41d7-91a6-ab7822dd0d8b" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-30878c33-8296-41d7-91a6-ab7822dd0d8b" released by "_delete_snapshot" :: held 1.532s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" released by "delete_snapshot" :: held 1.554s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:19 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['6615a63b-2512-44c7-9201-d1517cd82c15', '3e2ee487-d7f5-4392-8d3d-3540da593b25', '23d816e4-de9c-4c11-8bca-ee48e6734b93', 'afc3f6df-9cc7-4afa-a16c-ba1868559939'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Delete snapshot completed successfully. Aug 26 00:21:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4611c9c9-9e42-4f12-a97c-6d7e5adbd731 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-30878c33-8296-41d7-91a6-ab7822dd0d8b-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (43453793-4703-48a0-9c01-22b90f72fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66907204-c10c-4b40-a573-49d57a7f74c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66907204-c10c-4b40-a573-49d57a7f74c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-369342911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c632208d-b59c-4da8-b10b-14d4b5ada1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:20Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45438cb3-9f07-4e54-b8ec-a066dda42e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45438cb3-9f07-4e54-b8ec-a066dda42e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09447c29-7d92-4c29-a39d-c2f97d1505f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09447c29-7d92-4c29-a39d-c2f97d1505f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c632208d-b59c-4da8-b10b-14d4b5ada1ea', 'volume_name': 'volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed1c859-e93f-4eeb-9ccb-47ff371a99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed1c859-e93f-4eeb-9ccb-47ff371a99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc91cea-603e-4139-bc4f-f961941a52cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:20 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Volume c632208d-b59c-4da8-b10b-14d4b5ada1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea', 'volume_size': 1} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-369342911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c632208d-b59c-4da8-b10b-14d4b5ada1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:20Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Creating volume c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:20 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:20 devstack sudo[111315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea 1073741824 Aug 26 00:21:20 devstack sudo[111315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:20 devstack sudo[111315]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea 1073741824" returned: 0 in 0.537s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:20 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:21 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:21 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffc91cea-603e-4139-bc4f-f961941a52cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d073bb-b007-42d9-9159-17436f93427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Volume volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea (c632208d-b59c-4da8-b10b-14d4b5ada1ea): created successfully Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d073bb-b007-42d9-9159-17436f93427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (43453793-4703-48a0-9c01-22b90f72fd08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0ec3ff23-70d7-408a-b0e7-0849bc73dc4c tempest-VolumesSnapshotTestJSON-24263590 None] Created volume successfully. Aug 26 00:21:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Creating offline snapshot 862c6b62-e7e4-4be4-a344-86f8bc132433 of volume c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:21:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e2fa9-06b6-43bf-8b2e-8d45db7d7aa0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:22 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:22 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:23 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.414s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:23 devstack sudo[111332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 1G Aug 26 00:21:23 devstack sudo[111332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:23 devstack sudo[111332]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 1G" returned: 0 in 0.419s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:23 devstack sudo[111338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:23 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:23 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:23 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 is being set with open permissions: ugo+rw Aug 26 00:21:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:23 devstack sudo[111343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:23 devstack sudo[111343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:24 devstack sudo[111343]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:24 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info Aug 26 00:21:24 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:24 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:24 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info is being set with open permissions: ugo+rw Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:24 devstack sudo[111351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info Aug 26 00:21:24 devstack sudo[111351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:24 devstack sudo[111351]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.info" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-88b92030-d502-451a-96ff-c06bc4a5a847 tempest-VolumesSnapshotTestJSON-24263590 None] Create snapshot completed successfully Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (582137bc-d088-4c67-8c9c-44b15effdb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1f0d53-b42e-4bf2-84ef-304041302f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f1f0d53-b42e-4bf2-84ef-304041302f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-779067602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa05b3f6-063d-4930-a90f-0ecb89c1184e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=862c6b62-e7e4-4be4-a344-86f8bc132433,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:26Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8fb4fb-c3e3-418d-b8cf-b5fc3fb64f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8fb4fb-c3e3-418d-b8cf-b5fc3fb64f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f863b88-19f7-4021-b0ab-c0c3e51deebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f863b88-19f7-4021-b0ab-c0c3e51deebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fa05b3f6-063d-4930-a90f-0ecb89c1184e', 'volume_name': 'volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e', 'volume_size': 2, 'snapshot_id': '862c6b62-e7e4-4be4-a344-86f8bc132433'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e6c7a6-91e1-4d00-9315-1305f52ced2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e6c7a6-91e1-4d00-9315-1305f52ced2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde17ee6-7bf2-49cf-8945-dc8cb70256ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Volume fa05b3f6-063d-4930-a90f-0ecb89c1184e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e', 'volume_size': 2, 'snapshot_id': '862c6b62-e7e4-4be4-a344-86f8bc132433'} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433-fa05b3f6-063d-4930-a90f-0ecb89c1184e" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433-fa05b3f6-063d-4930-a90f-0ecb89c1184e" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Creating volume fa05b3f6-063d-4930-a90f-0ecb89c1184e from snapshot 862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] snapshot: 862c6b62-e7e4-4be4-a344-86f8bc132433, volume: fa05b3f6-063d-4930-a90f-0ecb89c1184e, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e5b493-6d91-40fe-8e1b-a11ceb84a579]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:26 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:26 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:26 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.388s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f913aee7-8009-48da-b40b-fb42b6343538]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:27 devstack sudo[111360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:27 devstack sudo[111360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:27 devstack sudo[111360]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.386s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:21:27 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:21:27 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:21:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:27 devstack sudo[111365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e Aug 26 00:21:27 devstack sudo[111365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (eb9550c5-8204-4d76-ad40-b1731a912c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557a483a-1791-4e2e-b9ab-b2903f7fc03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (557a483a-1791-4e2e-b9ab-b2903f7fc03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913813347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea5a757-ffda-40ff-ba32-faa32dfedf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:30Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590b040f-f65c-4e69-a23f-bc24263e46e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590b040f-f65c-4e69-a23f-bc24263e46e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672c884e-ce91-4411-9346-8e851d8dd064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672c884e-ce91-4411-9346-8e851d8dd064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ea5a757-ffda-40ff-ba32-faa32dfedf45', 'volume_name': 'volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7864a1b-f108-4ec5-9546-339d8ada7e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7864a1b-f108-4ec5-9546-339d8ada7e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639b3fc3-edb4-4901-81f5-4a40e1f715b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume 0ea5a757-ffda-40ff-ba32-faa32dfedf45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45', 'volume_size': 1} Aug 26 00:21:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:31 devstack sudo[111365]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e" returned: 0 in 4.670s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:31 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:21:31 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Converted 1024.00 MB image at 219.22 MB/s Aug 26 00:21:31 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e is being set with open permissions: ugo+rw Aug 26 00:21:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:32 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e Aug 26 00:21:32 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:32 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e" returned: 0 in 0.234s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" released by "_copy_volume_from_snapshot" :: held 5.764s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433-fa05b3f6-063d-4930-a90f-0ecb89c1184e" released by "_create_volume_from_snapshot" :: held 5.826s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.845s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1913813347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ea5a757-ffda-40ff-ba32-faa32dfedf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:30Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume 0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:32 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:32 devstack sudo[111383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 1073741824 Aug 26 00:21:32 devstack sudo[111383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde17ee6-7bf2-49cf-8945-dc8cb70256ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e', 'volume_size': 2, 'snapshot_id': '862c6b62-e7e4-4be4-a344-86f8bc132433'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22073bc4-f381-4cc8-8bf6-538a56ce9743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Volume volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e (fa05b3f6-063d-4930-a90f-0ecb89c1184e): created successfully Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22073bc4-f381-4cc8-8bf6-538a56ce9743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (582137bc-d088-4c67-8c9c-44b15effdb88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1480f110-efa5-4cdf-815b-89d405ea81dd tempest-VolumesSnapshotTestJSON-24263590 None] Created volume successfully. Aug 26 00:21:32 devstack sudo[111383]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 1073741824" returned: 0 in 0.421s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:32 devstack sudo[111388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 Aug 26 00:21:32 devstack sudo[111388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:32 devstack sudo[111388]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45" returned: 0 in 0.241s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639b3fc3-edb4-4901-81f5-4a40e1f715b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa5d69-4fed-4959-8554-3a680b543a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 (0ea5a757-ffda-40ff-ba32-faa32dfedf45): created successfully Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfa5d69-4fed-4959-8554-3a680b543a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (eb9550c5-8204-4d76-ad40-b1731a912c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-976367ac-9e47-47e0-94b5-b1d8c8593842 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-fa05b3f6-063d-4930-a90f-0ecb89c1184e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-fa05b3f6-063d-4930-a90f-0ecb89c1184e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" acquired by "delete_volume" :: waited 0.013s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2fc7c9-f61a-4843-9c7c-9e11c2e08d6c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:33 devstack sudo[111391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e Aug 26 00:21:33 devstack sudo[111391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:33 devstack sudo[111391]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:33 devstack sudo[111398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e Aug 26 00:21:33 devstack sudo[111398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating offline snapshot 05113bdd-7559-4a91-9963-860f4c416e3c of volume 0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[54df9df1-7ed1-4c27-80cc-2487c6296ae5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:33 devstack sudo[111398]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa05b3f6-063d-4930-a90f-0ecb89c1184e" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:33 devstack sudo[111400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 Aug 26 00:21:33 devstack sudo[111400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-fa05b3f6-063d-4930-a90f-0ecb89c1184e" released by "delete_volume" :: held 0.666s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:33 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['c7497581-3615-473b-838d-172484d32acb', '7335308c-62d5-4dfe-8612-3167f945e3cb', '9402cc02-a44f-4ea8-aba6-3cb385881bdf', '4dbea416-1715-4ade-9360-724414ac67cf'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:34 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:34 devstack sudo[111400]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c 1G Aug 26 00:21:34 devstack sudo[111408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:34 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Deleted volume successfully. Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-375b52fd-9417-41ba-93a6-78b84099b9ce tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-fa05b3f6-063d-4930-a90f-0ecb89c1184e-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-862c6b62-e7e4-4be4-a344-86f8bc132433-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-862c6b62-e7e4-4be4-a344-86f8bc132433-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Deleting offline snapshot 862c6b62-e7e4-4be4-a344-86f8bc132433 of volume c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] snapshot_file for this snap is: volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c049dfc-61ef-40f8-b135-951797fecc44]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:34 devstack sudo[111414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:34 devstack sudo[111408]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c 1G" returned: 0 in 0.452s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c Aug 26 00:21:34 devstack sudo[111417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:34 devstack sudo[111414]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1eb98-21c8-4fa5-b530-3f7e857e0ae9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111417]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c" returned: 0 in 0.310s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:34 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c is being set with open permissions: ugo+rw Aug 26 00:21:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:34 devstack sudo[111427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c Aug 26 00:21:34 devstack sudo[111427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:34 devstack sudo[111426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:34 devstack sudo[111426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:35 devstack sudo[111427]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c" returned: 0 in 0.240s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:35 devstack sudo[111433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info Aug 26 00:21:35 devstack sudo[111433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:35 devstack sudo[111426]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.557s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:35 devstack sudo[111433]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:35 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info is being set with open permissions: ugo+rw Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:35 devstack sudo[111437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:35 devstack sudo[111437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:35 devstack sudo[111438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info Aug 26 00:21:35 devstack sudo[111438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:35 devstack sudo[111438]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.info" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6b2b6bc4-3068-4737-a6f3-facf3b9d248b tempest-CreateVolumesFromSnapshotTest-752323354 None] Create snapshot completed successfully Aug 26 00:21:35 devstack sudo[111437]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:35 devstack sudo[111445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433 Aug 26 00:21:35 devstack sudo[111445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:36 devstack sudo[111445]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea.862c6b62-e7e4-4be4-a344-86f8bc132433" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-862c6b62-e7e4-4be4-a344-86f8bc132433" released by "_delete_snapshot" :: held 1.685s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" released by "delete_snapshot" :: held 1.714s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['718195d4-6702-4ecf-aa64-c1935c6f63fc', '743c612f-405d-459a-a8b3-c50c1fb072f7', '277ea445-149e-4303-800d-6a5f38a2e4c7', 'e920094d-1a72-4114-90ab-84d29c0e59e9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Delete snapshot completed successfully. Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f1180ff4-a1ca-4a9a-8e2d-f0788d1a7135 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-862c6b62-e7e4-4be4-a344-86f8bc132433-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (269ceffc-69c6-47a5-b96e-10c197321c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8051e57b-f28d-4359-9511-94e4ac921f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8051e57b-f28d-4359-9511-94e4ac921f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500473700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:36Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb9c27e-f239-4965-8bb2-dce466cdffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb9c27e-f239-4965-8bb2-dce466cdffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d172714-7057-40a1-856d-aabd6aca6939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d172714-7057-40a1-856d-aabd6aca6939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd', 'volume_name': 'volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246cd578-92d6-4f31-bf0a-724c44ff7a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246cd578-92d6-4f31-bf0a-724c44ff7a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52820879-aa13-4549-a2d6-ab5acf344a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd', 'volume_size': 1} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1500473700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:36Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:36 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:36 devstack sudo[111448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd 1073741824 Aug 26 00:21:36 devstack sudo[111448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-c632208d-b59c-4da8-b10b-14d4b5ada1ea-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-c632208d-b59c-4da8-b10b-14d4b5ada1ea-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (64dc8e32-5056-4f3e-8e10-f0bb65353c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed526710-ef0e-490a-85b6-cb3286457eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e258a3-2611-4e6f-b45b-5c099f65a69f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed526710-ef0e-490a-85b6-cb3286457eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246621350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc907c43-ff83-47cc-bc24-752955f9d2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:37Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c32545c-8346-4bf3-8b27-791cb82c39a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c32545c-8346-4bf3-8b27-791cb82c39a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22525d1-b0b8-4b80-bf47-3ec5b281ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d22525d1-b0b8-4b80-bf47-3ec5b281ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc907c43-ff83-47cc-bc24-752955f9d2db', 'volume_name': 'volume-cc907c43-ff83-47cc-bc24-752955f9d2db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cb4056-cf0f-4a90-8144-70a0abb115b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88cb4056-cf0f-4a90-8144-70a0abb115b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0d2071-ca0d-4b85-86b8-2e6cdb7857e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume cc907c43-ff83-47cc-bc24-752955f9d2db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc907c43-ff83-47cc-bc24-752955f9d2db', 'volume_size': 1} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:36 devstack sudo[111454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:36 devstack sudo[111454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:36 devstack sudo[111448]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd 1073741824" returned: 0 in 0.562s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:37 devstack sudo[111456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd Aug 26 00:21:37 devstack sudo[111456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (27437b18-c6ad-4692-84ed-b7189ddfa2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc4bada-a75c-4f10-bf09-c8a747aca286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc4bada-a75c-4f10-bf09-c8a747aca286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799474518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:37Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8785af8c-e63e-4e3c-9a74-77961ab60353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8785af8c-e63e-4e3c-9a74-77961ab60353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955e614-0f36-468a-a99e-69dd9ffdda93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3955e614-0f36-468a-a99e-69dd9ffdda93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc', 'volume_name': 'volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93193aa6-0e49-49c0-ad02-26ae9d66e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93193aa6-0e49-49c0-ad02-26ae9d66e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c6171c-8e7b-49ee-8b68-1f1d8292d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume 8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc', 'volume_size': 1} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:37 devstack sudo[111454]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.462s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:37 devstack sudo[111462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea Aug 26 00:21:37 devstack sudo[111462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:37 devstack sudo[111456]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" returned: 0 in 0.312s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-246621350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc907c43-ff83-47cc-bc24-752955f9d2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:37Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume cc907c43-ff83-47cc-bc24-752955f9d2db {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52820879-aa13-4549-a2d6-ab5acf344a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab48a05b-2392-48c2-959d-996488723337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db 1073741824 Aug 26 00:21:37 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd (cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd): created successfully Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab48a05b-2392-48c2-959d-996488723337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (269ceffc-69c6-47a5-b96e-10c197321c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-be11dca9-2c62-4c73-b1c4-f5dcf159d38e tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:37 devstack sudo[111462]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c632208d-b59c-4da8-b10b-14d4b5ada1ea" returned: 0 in 0.324s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (39bb7e8b-9818-4d7b-b956-04650d40edb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc0134a-cecc-44ef-bfa1-ded817739e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-c632208d-b59c-4da8-b10b-14d4b5ada1ea" released by "delete_volume" :: held 0.926s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfc0134a-cecc-44ef-bfa1-ded817739e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-769898553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a456ec7c-cc7a-42d6-911b-2990ae5f4739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:38Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecad427-9767-4e48-812e-7d1d12d0e6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecad427-9767-4e48-812e-7d1d12d0e6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3dee80-692e-4961-8124-e8d5ce022111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3dee80-692e-4961-8124-e8d5ce022111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a456ec7c-cc7a-42d6-911b-2990ae5f4739', 'volume_name': 'volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b7fc8-090d-459a-9b51-6736724af17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b58b7fc8-090d-459a-9b51-6736724af17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723df0c9-c09c-4504-b66a-a95e8c84d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:37 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume a456ec7c-cc7a-42d6-911b-2990ae5f4739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739', 'volume_size': 1} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['7b8964ca-2e4e-4163-a36f-9368d25c501e', '85cd0d89-c015-4d1b-8787-009b3925ec07', '63ebeeeb-cbf8-4626-9bb7-ba3df36f4ae3', 'ffb50e35-70de-4bb8-85b8-ad9be796c551'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:37 devstack sudo[111472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:37 devstack sudo[111472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:37 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db 1073741824" returned: 0 in 0.587s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:37 devstack sudo[111474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db Aug 26 00:21:37 devstack sudo[111474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (bb09d841-fdd8-486f-8a5d-3df9f931d47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf0ada-9402-4b9b-a2f6-753cefacea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bf0ada-9402-4b9b-a2f6-753cefacea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1086387278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d0d44d-bd20-47a0-ac6a-9c9f053acb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:38Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ad1546-048b-4837-8ffa-c229425f182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ad1546-048b-4837-8ffa-c229425f182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7458f55-d729-4fb4-a6ba-1ea8195acab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7458f55-d729-4fb4-a6ba-1ea8195acab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d0d44d-bd20-47a0-ac6a-9c9f053acb39', 'volume_name': 'volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5033dd7-6de1-45a3-8bd5-17bdd0d65a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5033dd7-6de1-45a3-8bd5-17bdd0d65a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a0f64a-b195-4773-a28f-583a8119e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume 15d0d44d-bd20-47a0-ac6a-9c9f053acb39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39', 'volume_size': 1} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:38 devstack sudo[111472]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.295s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Deleted volume successfully. Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-786ec86f-c89e-4a27-87cc-f8641c3f9f68 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-c632208d-b59c-4da8-b10b-14d4b5ada1ea-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:38 devstack sudo[111474]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799474518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:37Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume 8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0d2071-ca0d-4b85-86b8-2e6cdb7857e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc907c43-ff83-47cc-bc24-752955f9d2db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack sudo[111478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc 1073741824 Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668340c4-dd63-4136-a27d-8b45589c039f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:38 devstack sudo[111478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-cc907c43-ff83-47cc-bc24-752955f9d2db (cc907c43-ff83-47cc-bc24-752955f9d2db): created successfully Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (668340c4-dd63-4136-a27d-8b45589c039f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (64dc8e32-5056-4f3e-8e10-f0bb65353c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a95f5725-86d8-43d9-a25a-af973f8e29b6 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:38 devstack sudo[111478]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc 1073741824" returned: 0 in 0.400s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:38 devstack sudo[111484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc Aug 26 00:21:38 devstack sudo[111484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:38 devstack sudo[111484]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.243s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-769898553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a456ec7c-cc7a-42d6-911b-2990ae5f4739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:38Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume a456ec7c-cc7a-42d6-911b-2990ae5f4739 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:38 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:38 devstack sudo[111487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 1073741824 Aug 26 00:21:38 devstack sudo[111487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c6171c-8e7b-49ee-8b68-1f1d8292d98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60f3218-3ef4-4195-80b9-affe9ddd8456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc (8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc): created successfully Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60f3218-3ef4-4195-80b9-affe9ddd8456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (27437b18-c6ad-4692-84ed-b7189ddfa2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d1a2207f-b7f1-4fd8-8098-ff33d176d34b tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:39 devstack sudo[111487]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 1073741824" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:39 devstack sudo[111493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 Aug 26 00:21:39 devstack sudo[111493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (a0675ed1-d121-4299-9070-b93a34ecb9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3532b-7967-484b-b8ed-9fd8808239fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d3532b-7967-484b-b8ed-9fd8808239fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-62172941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c50bd8-f624-4198-8473-64f44a62a56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:39Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ab7e7e-9c80-47ea-bbf7-f28d88e43320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ab7e7e-9c80-47ea-bbf7-f28d88e43320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c638de-c3eb-4bc0-93c7-8362a9943dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c638de-c3eb-4bc0-93c7-8362a9943dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4c50bd8-f624-4198-8473-64f44a62a56d', 'volume_name': 'volume-a4c50bd8-f624-4198-8473-64f44a62a56d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5c8aaf-70b9-422c-9ac6-3fa15a87a95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b5c8aaf-70b9-422c-9ac6-3fa15a87a95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d226a54d-96ce-4eb5-97be-35d7f4b7dc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Volume a4c50bd8-f624-4198-8473-64f44a62a56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4c50bd8-f624-4198-8473-64f44a62a56d', 'volume_size': 1} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:39 devstack sudo[111493]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.572s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1086387278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d0d44d-bd20-47a0-ac6a-9c9f053acb39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9e09feec91e43918c3dc20a8f513163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:38Z,use_quota=True,user_id='1ad15f04728b4cafa7ae2cc7870e3a21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Creating volume 15d0d44d-bd20-47a0-ac6a-9c9f053acb39 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723df0c9-c09c-4504-b66a-a95e8c84d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack sudo[111496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 1073741824 Aug 26 00:21:39 devstack sudo[111496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ecb6dd-8a67-492c-8c1b-84827b403afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 (a456ec7c-cc7a-42d6-911b-2990ae5f4739): created successfully Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ecb6dd-8a67-492c-8c1b-84827b403afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (39bb7e8b-9818-4d7b-b956-04650d40edb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-219603ac-c32e-438a-9886-7de14f5cb5d4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:40 devstack sudo[111496]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 1073741824" returned: 0 in 0.415s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:40 devstack sudo[111502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 Aug 26 00:21:40 devstack sudo[111502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:40 devstack sudo[111502]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.851s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-62172941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4c50bd8-f624-4198-8473-64f44a62a56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:39Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Creating volume a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:40 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78a0f64a-b195-4773-a28f-583a8119e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:40 devstack sudo[111505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d 1073741824 Aug 26 00:21:40 devstack sudo[111505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1a12bb-2030-4ab8-8aea-5c43f6daeeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:40 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Volume volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 (15d0d44d-bd20-47a0-ac6a-9c9f053acb39): created successfully Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed1a12bb-2030-4ab8-8aea-5c43f6daeeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Flow 'volume_create_manager' (bb09d841-fdd8-486f-8a5d-3df9f931d47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-387d69c8-3d57-431e-9a02-46a421acd2cc tempest-CreateVolumesFromSnapshotTest-752323354 None] Created volume successfully. Aug 26 00:21:40 devstack sudo[111505]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d 1073741824" returned: 0 in 0.411s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:40 devstack sudo[111510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:40 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:41 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.241s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d226a54d-96ce-4eb5-97be-35d7f4b7dc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4c50bd8-f624-4198-8473-64f44a62a56d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d8312-6dd4-488c-af4e-04b36a7b7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:41 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Volume volume-a4c50bd8-f624-4198-8473-64f44a62a56d (a4c50bd8-f624-4198-8473-64f44a62a56d): created successfully Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157d8312-6dd4-488c-af4e-04b36a7b7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (a0675ed1-d121-4299-9070-b93a34ecb9e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-58a77d16-4562-43d6-8df5-0cdb28cc7ae3 tempest-VolumesSnapshotTestJSON-24263590 None] Created volume successfully. Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-15d0d44d-bd20-47a0-ac6a-9c9f053acb39-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-15d0d44d-bd20-47a0-ac6a-9c9f053acb39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04cd174-8d01-4176-8ea0-cdbcdfb722d1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:41 devstack sudo[111513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 Aug 26 00:21:41 devstack sudo[111513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Creating offline snapshot 35218d67-1e92-47f5-8f1e-f3645fafa369 of volume a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[64882a3e-5225-4446-bb86-ec8a9eb0a6da]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:41 devstack sudo[111515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:41 devstack sudo[111515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:41 devstack sudo[111513]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:41 devstack sudo[111520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39 Aug 26 00:21:41 devstack sudo[111520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:42 devstack sudo[111515]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:42 devstack sudo[111520]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:42 devstack sudo[111526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 1G Aug 26 00:21:42 devstack sudo[111526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" returned: 0 in 0.244s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-15d0d44d-bd20-47a0-ac6a-9c9f053acb39" released by "delete_volume" :: held 0.667s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['2bfca736-f1b8-47f3-a35b-6076a1497f94', 'ced9a5da-d2ae-4729-947b-b65b643d6b1d', '579a3d22-0733-4085-9ac5-44351cb0886f', '901282ac-2c02-4afb-b43d-99489cf947f8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:42 devstack sudo[111528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:42 devstack sudo[111528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:42 devstack sudo[111526]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 1G" returned: 0 in 0.430s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c50bd8-f624-4198-8473-64f44a62a56d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:42 devstack sudo[111528]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:42 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:42 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c50bd8-f624-4198-8473-64f44a62a56d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:42 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-a456ec7c-cc7a-42d6-911b-2990ae5f4739-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-a456ec7c-cc7a-42d6-911b-2990ae5f4739-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3e95264b-2c95-4f06-b0aa-725363f25de4 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-15d0d44d-bd20-47a0-ac6a-9c9f053acb39-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-a456ec7c-cc7a-42d6-911b-2990ae5f4739" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-a456ec7c-cc7a-42d6-911b-2990ae5f4739" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[56015537-5017-48c0-90c4-5189f155934b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:42 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 Aug 26 00:21:42 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:42 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4c50bd8-f624-4198-8473-64f44a62a56d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:42 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 is being set with open permissions: ugo+rw Aug 26 00:21:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:42 devstack sudo[111546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:42 devstack sudo[111546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:43 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:43 devstack sudo[111546]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack sudo[111552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739 Aug 26 00:21:43 devstack sudo[111552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:43 devstack sudo[111554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info Aug 26 00:21:43 devstack sudo[111554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:43 devstack sudo[111552]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a456ec7c-cc7a-42d6-911b-2990ae5f4739" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-a456ec7c-cc7a-42d6-911b-2990ae5f4739" released by "delete_volume" :: held 0.674s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:43 devstack sudo[111554]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info is being set with open permissions: ugo+rw Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['122692ac-3cd5-4bc5-af3d-6664654442fa', 'b825f221-593e-4398-a71c-f2aeaeaf26e1', '51f62646-f77c-478c-9d68-ee5256f4fe6b', 'a51f1cb8-e87f-42ad-872a-6c3dd4ca2f7d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:43 devstack sudo[111558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info Aug 26 00:21:43 devstack sudo[111558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:43 devstack sudo[111560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:43 devstack sudo[111560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:43 devstack sudo[111558]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.info" returned: 0 in 0.238s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a2a92057-7e1d-4615-a385-9af926773c98 tempest-VolumesSnapshotTestJSON-24263590 None] Create snapshot completed successfully Aug 26 00:21:43 devstack sudo[111560]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-2dbd7304-948f-459a-a656-fd1fc1d2bf7b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-a456ec7c-cc7a-42d6-911b-2990ae5f4739-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1920c831-2b94-4d86-a3c7-9b3b648b7593]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:44 devstack sudo[111564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc Aug 26 00:21:44 devstack sudo[111564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:44 devstack sudo[111564]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:44 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc Aug 26 00:21:44 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (8c7e1859-024c-43cb-a430-bf8bbe3896d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fcf957-ddc5-4908-acf5-d3388c7fed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fcf957-ddc5-4908-acf5-d3388c7fed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2112288691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=895bb5d9-b1f3-462e-a967-021329116bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce8a3590b6bc4e30a3cd464a3e053a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=35218d67-1e92-47f5-8f1e-f3645fafa369,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:44Z,use_quota=True,user_id='05d29f40e21541babc0c5916b5de81f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33ed042-7198-4bc6-bfe0-45112813189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a33ed042-7198-4bc6-bfe0-45112813189c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b805db-3c91-4ee8-a0d4-4bc885fd67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7b805db-3c91-4ee8-a0d4-4bc885fd67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '895bb5d9-b1f3-462e-a967-021329116bbf', 'volume_name': 'volume-895bb5d9-b1f3-462e-a967-021329116bbf', 'volume_size': 1, 'snapshot_id': '35218d67-1e92-47f5-8f1e-f3645fafa369'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ac8fa2-eb53-4371-8fac-0cfc81abe8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ac8fa2-eb53-4371-8fac-0cfc81abe8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00f7724-2e3a-4532-a740-3e3e166e2b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:44 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Volume 895bb5d9-b1f3-462e-a967-021329116bbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-895bb5d9-b1f3-462e-a967-021329116bbf', 'volume_size': 1, 'snapshot_id': '35218d67-1e92-47f5-8f1e-f3645fafa369'} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369-895bb5d9-b1f3-462e-a967-021329116bbf" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369-895bb5d9-b1f3-462e-a967-021329116bbf" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Creating volume 895bb5d9-b1f3-462e-a967-021329116bbf from snapshot 35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] snapshot: 35218d67-1e92-47f5-8f1e-f3645fafa369, volume: 895bb5d9-b1f3-462e-a967-021329116bbf, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:44 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc" released by "delete_volume" :: held 0.708s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aec879-7b16-4a6b-9e26-223c0e0f797d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['1d64b5cc-9863-46bc-be74-301e76195648', '4ada1569-c252-4031-868d-7a4eb85be01b', 'b4ab9430-4927-4361-bb41-f72eed0de810', '50eb763b-ee0e-47e5-bb0e-197cb9b9eb56'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:44 devstack sudo[111572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:44 devstack sudo[111572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:44 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:44 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-cc907c43-ff83-47cc-bc24-752955f9d2db-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:45 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-cc907c43-ff83-47cc-bc24-752955f9d2db-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:45 devstack sudo[111572]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c50bd8-f624-4198-8473-64f44a62a56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e387fce-d385-422c-99e2-04f627fbf224 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-8fed337f-f0c6-4961-b6c1-ce9cdcb39ddc-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4441cdaf-741a-4a6f-9180-d7497872a7f8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-cc907c43-ff83-47cc-bc24-752955f9d2db" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-cc907c43-ff83-47cc-bc24-752955f9d2db" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec1ab6-ea14-494f-a686-70a25dfde199]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:45 devstack sudo[111580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:45 devstack sudo[111580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:45 devstack sudo[111581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db Aug 26 00:21:45 devstack sudo[111581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:45 devstack sudo[111580]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:45 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf Aug 26 00:21:45 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:45 devstack sudo[111581]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:45 devstack sudo[111592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db Aug 26 00:21:45 devstack sudo[111592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:45 devstack sudo[111592]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cc907c43-ff83-47cc-bc24-752955f9d2db" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-cc907c43-ff83-47cc-bc24-752955f9d2db" released by "delete_volume" :: held 0.678s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['547c40f5-b1aa-4bcb-8547-c458751ac30c', 'c1055bdc-1074-4c38-a1e5-6f82ab83bd38', '2c0387e9-254f-483a-b6c6-35bb8c09a91d', '7fbdf7b3-a371-44af-8c05-74cf9199d27c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:45 devstack sudo[111599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:45 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:46 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc14a9da-6f7a-4dd8-a8c6-c18d05fca28c tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-cc907c43-ff83-47cc-bc24-752955f9d2db-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:46 devstack sudo[111608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:46 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" acquired by "delete_volume" :: waited 0.040s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e2804b-4539-49f6-91a5-411f49512b9e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:47 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.526s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:21:47 devstack sudo[111610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd Aug 26 00:21:47 devstack sudo[111610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:47 devstack sudo[111610]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" returned: 0 in 0.863s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:47 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd Aug 26 00:21:47 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:48 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" returned: 0 in 0.521s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd" released by "delete_volume" :: held 1.473s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['a227d99f-fc41-4bf9-89ba-d931349a11e1', '7a53f3f3-9ebb-4c9d-91b0-1683f179c5d3', 'e1eb6539-8718-49fb-8441-a4f1b81b7020', 'd312b753-c258-4e20-8ea4-6258610a9028'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:48 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:48 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:48 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.373s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-05113bdd-7559-4a91-9963-860f4c416e3c-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-15506560-e87c-43ee-bb65-6f960d4bc26b tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-cbd3c0d1-ef3d-4729-9ffe-7d32795e1edd-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-05113bdd-7559-4a91-9963-860f4c416e3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" acquired by "delete_snapshot" :: waited 0.060s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-05113bdd-7559-4a91-9963-860f4c416e3c" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-05113bdd-7559-4a91-9963-860f4c416e3c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleting offline snapshot 05113bdd-7559-4a91-9963-860f4c416e3c of volume 0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:21:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] snapshot_file for this snap is: volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:21:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08cc341-46ea-4d13-a0a7-3e0eca426747]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:49 devstack sudo[111624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c Aug 26 00:21:49 devstack sudo[111624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:50 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf" returned: 0 in 4.865s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:21:50 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Converted 1024.00 MB image at 210.42 MB/s Aug 26 00:21:50 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf is being set with open permissions: ugo+rw Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:50 devstack sudo[111624]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c" returned: 0 in 1.221s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:50 devstack sudo[111629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf Aug 26 00:21:50 devstack sudo[111629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d830dd74-d2d8-4b3a-8786-01fbe7bea754]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:50 devstack sudo[111631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 Aug 26 00:21:50 devstack sudo[111631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:50 devstack sudo[111629]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" released by "_copy_volume_from_snapshot" :: held 5.997s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369-895bb5d9-b1f3-462e-a967-021329116bbf" released by "_create_volume_from_snapshot" :: held 6.057s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.074s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00f7724-2e3a-4532-a740-3e3e166e2b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-895bb5d9-b1f3-462e-a967-021329116bbf', 'volume_size': 1, 'snapshot_id': '35218d67-1e92-47f5-8f1e-f3645fafa369'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa57ba1-8cd7-4df7-bd80-2181031195c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:50 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Volume volume-895bb5d9-b1f3-462e-a967-021329116bbf (895bb5d9-b1f3-462e-a967-021329116bbf): created successfully Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa57ba1-8cd7-4df7-bd80-2181031195c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Flow 'volume_create_manager' (8c7e1859-024c-43cb-a430-bf8bbe3896d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:50 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-81cbf92f-b6e0-4646-a6a2-0dfa4ed47a16 tempest-VolumesSnapshotTestJSON-24263590 None] Created volume successfully. Aug 26 00:21:50 devstack sudo[111631]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45" returned: 0 in 0.369s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:50 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c Aug 26 00:21:50 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:51 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c" returned: 0 in 0.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:51 devstack sudo[111642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c Aug 26 00:21:51 devstack sudo[111642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:51 devstack sudo[111642]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45.05113bdd-7559-4a91-9963-860f4c416e3c" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-05113bdd-7559-4a91-9963-860f4c416e3c" released by "_delete_snapshot" :: held 2.333s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" released by "delete_snapshot" :: held 2.384s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-895bb5d9-b1f3-462e-a967-021329116bbf-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['34ced875-c9cc-481b-bca2-447a05fc6ce2', '012e04db-2e9a-49c2-bf7f-fec1515be33e', '88e342a6-c0cf-4e5d-834e-4f689ca87b81', 'ff2dd58e-08fd-4201-a2a1-61e9014b42e9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-895bb5d9-b1f3-462e-a967-021329116bbf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Delete snapshot completed successfully. Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c713442-9acf-46dd-85a8-a2de8a0b3c17 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-05113bdd-7559-4a91-9963-860f4c416e3c-delete_snapshot" released by "delete_snapshot" :: held 2.623s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e3433-e02a-4bec-855f-7f9b1c0bb57a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:51 devstack sudo[111645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf Aug 26 00:21:51 devstack sudo[111645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:51 devstack sudo[111645]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:51 devstack sudo[111650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf Aug 26 00:21:51 devstack sudo[111650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:52 devstack sudo[111650]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-895bb5d9-b1f3-462e-a967-021329116bbf" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-895bb5d9-b1f3-462e-a967-021329116bbf" released by "delete_volume" :: held 0.643s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['2b8af087-8372-4046-aa28-86e9a9071f17', '487d61a5-3647-4b8d-a8cf-83bc275a4ab9', '13066944-5fa1-458e-97df-798743973aff', '75591f5f-3609-4c91-a532-cc7f1a59f5cb'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-0ea5a757-ffda-40ff-ba32-faa32dfedf45-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-0ea5a757-ffda-40ff-ba32-faa32dfedf45-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" acquired by "delete_volume" :: waited 0.037s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:52 devstack sudo[111653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:52 devstack sudo[111653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a71ba0-86ed-414d-bc4c-9d8ed55bd2bb]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:52 devstack sudo[111655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 Aug 26 00:21:52 devstack sudo[111655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:52 devstack sudo[111653]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Deleted volume successfully. Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2260c19-9acc-416f-9b44-03fbb8fd8d14 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-895bb5d9-b1f3-462e-a967-021329116bbf-delete_volume" released by "delete_volume" :: held 1.165s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-35218d67-1e92-47f5-8f1e-f3645fafa369-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-35218d67-1e92-47f5-8f1e-f3645fafa369-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Deleting offline snapshot 35218d67-1e92-47f5-8f1e-f3645fafa369 of volume a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] snapshot_file for this snap is: volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[49727edb-6795-407d-a335-d9e7772e70c7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:52 devstack sudo[111655]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45" returned: 0 in 0.396s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:52 devstack sudo[111662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45 Aug 26 00:21:52 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:52 devstack sudo[111661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:52 devstack sudo[111661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:53 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0ea5a757-ffda-40ff-ba32-faa32dfedf45" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-quobyte-0ea5a757-ffda-40ff-ba32-faa32dfedf45" released by "delete_volume" :: held 0.720s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Created reservations ['bab52d53-9ccf-46e8-95d5-a9e60358304c', '2850cedc-c9d1-4655-8e46-7239bd78ab51', '25583bdf-77c5-48b5-8283-98dbeea81707', '6da2d2e2-bc12-4fe0-8cc4-4c9985d8388a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:53 devstack sudo[111661]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.402s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4c50bd8-f624-4198-8473-64f44a62a56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c9f28-e8ca-4bb0-9cc1-48492d0d4fad]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:53 devstack sudo[111673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:53 devstack sudo[111673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:53 devstack sudo[111672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:53 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:53 devstack sudo[111673]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Deleted volume successfully. Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a9011887-bb14-476b-b91f-e01a61154da9 tempest-CreateVolumesFromSnapshotTest-752323354 None] Lock "cinder-0ea5a757-ffda-40ff-ba32-faa32dfedf45-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:53 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.585s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:53 devstack sudo[111680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:53 devstack sudo[111680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:54 devstack sudo[111680]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:54 devstack sudo[111686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369 Aug 26 00:21:54 devstack sudo[111686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:54 devstack sudo[111686]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d.35218d67-1e92-47f5-8f1e-f3645fafa369" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-35218d67-1e92-47f5-8f1e-f3645fafa369" released by "_delete_snapshot" :: held 1.734s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" released by "delete_snapshot" :: held 1.761s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['f194bb15-d631-4d58-82af-01e2d77d199b', '567d7788-568c-4911-a975-3e4a3b942176', 'b9e31723-54f4-453a-8c43-9ab6634103fd', '00e0efac-a605-4f00-901b-bb6e7bd27d71'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=158,cinder:UPDATE=159,cinder:INSERT=41,cinder:DELETE=15 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=138,cinder:UPDATE=173,cinder:INSERT=42,cinder:DELETE=13 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:21:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Delete snapshot completed successfully. Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-95446663-4f55-483a-9793-4948779a2684 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-35218d67-1e92-47f5-8f1e-f3645fafa369-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-a4c50bd8-f624-4198-8473-64f44a62a56d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-a4c50bd8-f624-4198-8473-64f44a62a56d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" acquired by "delete_volume" :: waited 0.013s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ae0d8-138f-491d-a964-ab508a9d09bd]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:55 devstack sudo[111689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:55 devstack sudo[111689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:55 devstack sudo[111689]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:55 devstack sudo[111694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d Aug 26 00:21:55 devstack sudo[111694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:55 devstack sudo[111694]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a4c50bd8-f624-4198-8473-64f44a62a56d" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a4c50bd8-f624-4198-8473-64f44a62a56d" released by "delete_volume" :: held 0.701s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['459a2b5a-7469-4896-b78f-28376dd00d5b', '2cd4f07a-d93a-4cfc-bfa2-70769c87acee', 'e6552bcd-67cf-47ef-89cf-9a539bf43ee9', 'a4b5ac45-d2a3-48e4-9d87-8cf95d310005'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:55 devstack sudo[111697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:55 devstack sudo[111697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:56 devstack sudo[111697]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.279s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Deleted volume successfully. Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cba03a64-7827-4baa-85a4-f6ebf9d7a7c7 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-a4c50bd8-f624-4198-8473-64f44a62a56d-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-a6eada99-5f9e-466d-b36e-5b9d730a3f12-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-a6eada99-5f9e-466d-b36e-5b9d730a3f12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da75a6f-6b62-4498-ad40-a14baa1cecdf]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (46cc76d1-cb50-4545-9f4d-45410b476b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9162d4d3-ef9b-4f01-aad7-34e569e0ee8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9162d4d3-ef9b-4f01-aad7-34e569e0ee8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094626083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ff1b77-f85c-48d6-9403-829e359996bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:56Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc05073-d210-427d-842d-e1de934cdc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcc05073-d210-427d-842d-e1de934cdc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ed25a-0217-45e7-814a-3323c2979f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (737ed25a-0217-45e7-814a-3323c2979f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ff1b77-f85c-48d6-9403-829e359996bb', 'volume_name': 'volume-79ff1b77-f85c-48d6-9403-829e359996bb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bff786-f1e8-4ec3-a90d-258ed8197fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bff786-f1e8-4ec3-a90d-258ed8197fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99643bbd-19cd-4d5e-a41d-e4f5d4c442ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume 79ff1b77-f85c-48d6-9403-829e359996bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ff1b77-f85c-48d6-9403-829e359996bb', 'volume_size': 1} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1094626083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ff1b77-f85c-48d6-9403-829e359996bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:56Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume 79ff1b77-f85c-48d6-9403-829e359996bb {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:56 devstack sudo[111700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:56 devstack sudo[111700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:56 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:56 devstack sudo[111702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb 1073741824 Aug 26 00:21:56 devstack sudo[111702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:56 devstack sudo[111700]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:56 devstack sudo[111710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12 Aug 26 00:21:56 devstack sudo[111710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:56 devstack sudo[111702]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb 1073741824" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:56 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb Aug 26 00:21:56 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:56 devstack sudo[111710]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a6eada99-5f9e-466d-b36e-5b9d730a3f12" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-quobyte-a6eada99-5f9e-466d-b36e-5b9d730a3f12" released by "delete_volume" :: held 0.699s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:56 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Created reservations ['ce7c2577-dc72-4a5c-a7f5-2891a762b041', '0e291486-156f-454d-93a1-c39ba940248a', '0ba9295e-4c34-4ab7-88ea-301145c6683e', '49341332-2385-44ed-82c7-d3d4dec47c6e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:21:57 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99643bbd-19cd-4d5e-a41d-e4f5d4c442ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ff1b77-f85c-48d6-9403-829e359996bb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6626e5-4378-447f-8cba-7adc4ca3dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-79ff1b77-f85c-48d6-9403-829e359996bb (79ff1b77-f85c-48d6-9403-829e359996bb): created successfully Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6626e5-4378-447f-8cba-7adc4ca3dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:21:57 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (46cc76d1-cb50-4545-9f4d-45410b476b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-897c07eb-99e5-49a8-bb50-f93366d4ecf8 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:21:57 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:21:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Deleted volume successfully. Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8bfae35e-2cda-444e-9328-4ace6cf28d83 tempest-VolumesSnapshotTestJSON-24263590 None] Lock "cinder-a6eada99-5f9e-466d-b36e-5b9d730a3f12-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (de536dce-987d-4eda-bc1d-828b8038cef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca56e67d-c759-4ebc-85f1-5c0556373296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca56e67d-c759-4ebc-85f1-5c0556373296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472191467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d422ce1-d24d-496f-8e5e-f5d69da9348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:58Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662e12d0-fa24-401c-a102-a5839436e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (662e12d0-fa24-401c-a102-a5839436e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b8790a-7d24-4fa6-93dd-93ccfc44ed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b8790a-7d24-4fa6-93dd-93ccfc44ed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d422ce1-d24d-496f-8e5e-f5d69da9348a', 'volume_name': 'volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ef2cc-7575-485d-8659-8e367be75923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46ef2cc-7575-485d-8659-8e367be75923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e863632-3435-4d6b-871c-9219feb5c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume 1d422ce1-d24d-496f-8e5e-f5d69da9348a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a', 'volume_size': 1} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-472191467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d422ce1-d24d-496f-8e5e-f5d69da9348a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:58Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume 1d422ce1-d24d-496f-8e5e-f5d69da9348a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:57 devstack sudo[111721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a 1073741824 Aug 26 00:21:57 devstack sudo[111721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (1e6ba26e-423b-487d-aabc-1163417c9c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e66db13-a3b8-46ec-8f9f-230b59a81150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e66db13-a3b8-46ec-8f9f-230b59a81150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434112276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e25142-b09c-425b-8051-52aa3eff47e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:58Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795f1200-1e23-49a7-8666-6d11ffd457b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (795f1200-1e23-49a7-8666-6d11ffd457b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349a0b96-a6c2-4b48-8d04-8962640fed04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349a0b96-a6c2-4b48-8d04-8962640fed04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e25142-b09c-425b-8051-52aa3eff47e4', 'volume_name': 'volume-56e25142-b09c-425b-8051-52aa3eff47e4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa884679-d701-4c81-ae5a-b13d1d78dfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa884679-d701-4c81-ae5a-b13d1d78dfcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98897c24-b14b-4abb-a574-50019dfd6383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume 56e25142-b09c-425b-8051-52aa3eff47e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e25142-b09c-425b-8051-52aa3eff47e4', 'volume_size': 1} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:58 devstack sudo[111721]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a 1073741824" returned: 0 in 0.544s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:58 devstack sudo[111727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a Aug 26 00:21:58 devstack sudo[111727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:58 devstack sudo[111727]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (d1d8aede-aab0-4549-9e97-655f255c4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feabdb5e-e561-481d-a671-dad3599ce198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a" returned: 0 in 0.355s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.537s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434112276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e25142-b09c-425b-8051-52aa3eff47e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:58Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume 56e25142-b09c-425b-8051-52aa3eff47e4 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:58 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:58 devstack sudo[111730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 1073741824 Aug 26 00:21:58 devstack sudo[111730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feabdb5e-e561-481d-a671-dad3599ce198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422656301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42c6bd3-1473-4ebc-bcda-d05300dcef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:59Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f307c21d-fe12-48ce-ac84-284c7af99617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f307c21d-fe12-48ce-ac84-284c7af99617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ba9ffb-6861-4bcf-8413-9bf0040b6cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46ba9ffb-6861-4bcf-8413-9bf0040b6cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e42c6bd3-1473-4ebc-bcda-d05300dcef0f', 'volume_name': 'volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b027e9d-a35e-4e66-a6fe-dd07557bd206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b027e9d-a35e-4e66-a6fe-dd07557bd206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05af1e4-f8c4-4463-b6c7-a0ad472a1eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume e42c6bd3-1473-4ebc-bcda-d05300dcef0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f', 'volume_size': 1} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e863632-3435-4d6b-871c-9219feb5c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e8e7ca-dd19-49db-91b1-02d0a8b79cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a (1d422ce1-d24d-496f-8e5e-f5d69da9348a): created successfully Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24e8e7ca-dd19-49db-91b1-02d0a8b79cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (de536dce-987d-4eda-bc1d-828b8038cef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ad1d62e6-dfe2-45f6-a99b-f160ad559c27 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (3a56f8db-884e-4f57-a03e-70027010dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f2ee59-4563-46c6-8f4c-b4cb8e84d6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f2ee59-4563-46c6-8f4c-b4cb8e84d6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132163060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05cd0d-efb8-4916-8651-8bfcd233efc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:59Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc41810-70b6-4cb2-9794-f6ec4058fa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc41810-70b6-4cb2-9794-f6ec4058fa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b77c6a-d906-4ac9-ad6a-e3fc24f1729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b77c6a-d906-4ac9-ad6a-e3fc24f1729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d05cd0d-efb8-4916-8651-8bfcd233efc7', 'volume_name': 'volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abc0ab6-1cd4-48c2-af31-c2e8fe55615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abc0ab6-1cd4-48c2-af31-c2e8fe55615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5131bbc0-6fb1-4b5c-bacf-f39156ad324b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume 8d05cd0d-efb8-4916-8651-8bfcd233efc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7', 'volume_size': 1} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:59 devstack sudo[111730]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 1073741824" returned: 0 in 0.544s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:59 devstack sudo[111736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 Aug 26 00:21:59 devstack sudo[111736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (1018cc29-5057-4212-9138-ddd4793858eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a57d44-1423-4dbc-923f-d6b2b1f1c032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16a57d44-1423-4dbc-923f-d6b2b1f1c032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112437617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa11e42a-af53-4ddd-b866-27928e9111d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:00Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073bed2-6637-4f7f-91d3-221d62fb4377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b073bed2-6637-4f7f-91d3-221d62fb4377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d165a02a-dac0-4683-bad3-96efb932e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d165a02a-dac0-4683-bad3-96efb932e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa11e42a-af53-4ddd-b866-27928e9111d2', 'volume_name': 'volume-fa11e42a-af53-4ddd-b866-27928e9111d2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d90001f-1271-4f3f-afbb-e9245e8bc114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d90001f-1271-4f3f-afbb-e9245e8bc114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d569a359-0991-4c60-a613-1830341f7e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume fa11e42a-af53-4ddd-b866-27928e9111d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa11e42a-af53-4ddd-b866-27928e9111d2', 'volume_size': 1} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:59 devstack sudo[111736]: pam_unix(sudo:session): session closed for user root Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4" returned: 0 in 0.285s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-422656301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e42c6bd3-1473-4ebc-bcda-d05300dcef0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:59Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume e42c6bd3-1473-4ebc-bcda-d05300dcef0f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:21:59 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:21:59 devstack sudo[111740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f 1073741824 Aug 26 00:21:59 devstack sudo[111740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98897c24-b14b-4abb-a574-50019dfd6383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e25142-b09c-425b-8051-52aa3eff47e4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63007011-572f-40a7-a150-a7715785e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:21:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-56e25142-b09c-425b-8051-52aa3eff47e4 (56e25142-b09c-425b-8051-52aa3eff47e4): created successfully Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63007011-572f-40a7-a150-a7715785e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:21:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (1e6ba26e-423b-487d-aabc-1163417c9c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:21:59 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-47af8b0d-0d81-496a-8502-e126307f7f0b tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:22:00 devstack sudo[111740]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f 1073741824" returned: 0 in 0.500s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:00 devstack sudo[111746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f Aug 26 00:22:00 devstack sudo[111746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:00 devstack sudo[111746]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.294s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2132163060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d05cd0d-efb8-4916-8651-8bfcd233efc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:21:59Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume 8d05cd0d-efb8-4916-8651-8bfcd233efc7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:00 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:00 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 1073741824 Aug 26 00:22:00 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c05af1e4-f8c4-4463-b6c7-a0ad472a1eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a83835-fd38-4c0b-91fd-f0df6469ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f (e42c6bd3-1473-4ebc-bcda-d05300dcef0f): created successfully Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20a83835-fd38-4c0b-91fd-f0df6469ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (d1d8aede-aab0-4549-9e97-655f255c4c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-82a28f55-91ba-4e45-8689-10b5cba7dcf6 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:22:01 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 1073741824" returned: 0 in 0.512s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:01 devstack sudo[111790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 Aug 26 00:22:01 devstack sudo[111790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:01 devstack sudo[111790]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7" returned: 0 in 0.237s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.684s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1112437617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa11e42a-af53-4ddd-b866-27928e9111d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d891613476614782a45f981c05d3cb67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:00Z,use_quota=True,user_id='f89225892f684a6ea213882ee2d47d0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Creating volume fa11e42a-af53-4ddd-b866-27928e9111d2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:01 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5131bbc0-6fb1-4b5c-bacf-f39156ad324b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:01 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 1073741824 Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07481e77-0013-4233-8cad-4faa68c3db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:01 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 (8d05cd0d-efb8-4916-8651-8bfcd233efc7): created successfully Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07481e77-0013-4233-8cad-4faa68c3db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (3a56f8db-884e-4f57-a03e-70027010dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8f174f05-8adf-4258-ba9f-65b742b6195c tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:22:01 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 1073741824" returned: 0 in 0.447s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:01 devstack sudo[111798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 Aug 26 00:22:01 devstack sudo[111798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:02 devstack sudo[111798]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2" returned: 0 in 0.302s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d569a359-0991-4c60-a613-1830341f7e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa11e42a-af53-4ddd-b866-27928e9111d2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f852d9-507b-488b-94e7-c2afae43e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Volume volume-fa11e42a-af53-4ddd-b866-27928e9111d2 (fa11e42a-af53-4ddd-b866-27928e9111d2): created successfully Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0f852d9-507b-488b-94e7-c2afae43e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Flow 'volume_create_manager' (1018cc29-5057-4212-9138-ddd4793858eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b23b2f29-956e-4397-aa27-d2d6c9396181 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created volume successfully. Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-fa11e42a-af53-4ddd-b866-27928e9111d2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-fa11e42a-af53-4ddd-b866-27928e9111d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-fa11e42a-af53-4ddd-b866-27928e9111d2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-fa11e42a-af53-4ddd-b866-27928e9111d2" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[749dfbea-d32c-440c-9128-03478ad3af30]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:03 devstack sudo[111802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 Aug 26 00:22:03 devstack sudo[111802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:03 devstack sudo[111802]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2" returned: 0 in 0.416s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:03 devstack sudo[111807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2 Aug 26 00:22:03 devstack sudo[111807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:03 devstack sudo[111807]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fa11e42a-af53-4ddd-b866-27928e9111d2" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-fa11e42a-af53-4ddd-b866-27928e9111d2" released by "delete_volume" :: held 0.742s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['8d69da56-5203-4c83-8d39-cf3a2f8cd2c5', '9c6a0042-d617-4312-8690-5abb44674869', '9c9426a6-e55c-460a-bb84-7f058a6a76ba', 'f938533a-409e-412f-ac0e-4daa3f9bb0e8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:04 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:04 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-8d05cd0d-efb8-4916-8651-8bfcd233efc7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-8d05cd0d-efb8-4916-8651-8bfcd233efc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:04 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-8d05cd0d-efb8-4916-8651-8bfcd233efc7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a040aaa7-37ee-4b01-8f78-0bd7b49d7500 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-fa11e42a-af53-4ddd-b866-27928e9111d2-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-8d05cd0d-efb8-4916-8651-8bfcd233efc7" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b6614-318a-4ab6-a965-c449cd7e9215]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:04 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 Aug 26 00:22:04 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:04 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7" returned: 0 in 0.391s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:04 devstack sudo[111818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7 Aug 26 00:22:04 devstack sudo[111818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:05 devstack sudo[111818]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8d05cd0d-efb8-4916-8651-8bfcd233efc7" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-8d05cd0d-efb8-4916-8651-8bfcd233efc7" released by "delete_volume" :: held 0.699s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['d8f5d9be-6e2d-4f31-ad3f-745e8b571086', '182eca9d-a78d-4d30-b1ad-5b89279d6c8a', '5702943d-3ab2-4843-9561-d177ce3cea25', '84ddeeb4-36c3-4868-9466-37d7967da271'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:05 devstack sudo[111821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:05 devstack sudo[111821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Flow 'volume_create_manager' (e6b7377d-c4b3-4bd6-b5be-a00d44707e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8f134-e4b5-45f3-8d0a-3c93f85ddf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc8f134-e4b5-45f3-8d0a-3c93f85ddf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-55338109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0b611e-a995-47fe-8f65-add357d4660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e5dd9e3734d6199e26189c8bf6c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:05Z,use_quota=True,user_id='ecf1f8f9dd2641b08a60207ea6d2a2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf77122-0504-4569-8091-de469bb19066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abf77122-0504-4569-8091-de469bb19066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f2649-7ddb-474e-be1f-e4dcfa10ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e6f2649-7ddb-474e-be1f-e4dcfa10ad08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0b611e-a995-47fe-8f65-add357d4660d', 'volume_name': 'volume-9c0b611e-a995-47fe-8f65-add357d4660d', 'volume_size': 2}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d42c92-e782-4b7c-b6fb-70a02d1d798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d42c92-e782-4b7c-b6fb-70a02d1d798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2968328-7db8-4c46-9f1f-d7de5abc649b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:05 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Volume 9c0b611e-a995-47fe-8f65-add357d4660d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0b611e-a995-47fe-8f65-add357d4660d', 'volume_size': 2} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-55338109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c0b611e-a995-47fe-8f65-add357d4660d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='313e5dd9e3734d6199e26189c8bf6c3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:05Z,use_quota=True,user_id='ecf1f8f9dd2641b08a60207ea6d2a2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Creating volume 9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:05 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d 2147483648 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:05 devstack sudo[111823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d 2147483648 Aug 26 00:22:05 devstack sudo[111823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:05 devstack sudo[111821]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-e42c6bd3-1473-4ebc-bcda-d05300dcef0f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-e42c6bd3-1473-4ebc-bcda-d05300dcef0f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ee630061-d18b-45da-a97b-e3caf2e75a18 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-8d05cd0d-efb8-4916-8651-8bfcd233efc7-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13f380d-97df-4d70-8d50-6a7cbb97405d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:05 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f Aug 26 00:22:05 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:05 devstack sudo[111823]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d 2147483648" returned: 0 in 0.525s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:06 devstack sudo[111835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d Aug 26 00:22:06 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:06 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" returned: 0 in 0.419s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:06 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f Aug 26 00:22:06 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:06 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2968328-7db8-4c46-9f1f-d7de5abc649b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0b611e-a995-47fe-8f65-add357d4660d', 'volume_size': 2}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29275e3d-221b-4029-8bf0-eec6b7013ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Volume volume-9c0b611e-a995-47fe-8f65-add357d4660d (9c0b611e-a995-47fe-8f65-add357d4660d): created successfully Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29275e3d-221b-4029-8bf0-eec6b7013ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:06 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Flow 'volume_create_manager' (e6b7377d-c4b3-4bd6-b5be-a00d44707e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" returned: 0 in 0.278s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-e42c6bd3-1473-4ebc-bcda-d05300dcef0f" released by "delete_volume" :: held 0.736s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9e8362a0-5cbe-4b3f-8f72-8f3abc90cd35 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Created volume successfully. Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['c8e16845-adef-4740-8913-aa8cd8d6b7c7', 'b561ccc6-57c2-4abe-9e70-930fdb7d82b8', '56b39c61-001e-48d6-8616-6182d73bc71e', 'ea1a202f-b02b-40e7-8085-fd643798a97b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:06 devstack sudo[111841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:06 devstack sudo[111841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-56e25142-b09c-425b-8051-52aa3eff47e4-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-56e25142-b09c-425b-8051-52aa3eff47e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:06 devstack sudo[111841]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.267s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-56e25142-b09c-425b-8051-52aa3eff47e4" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c2e8c9ab-a528-4368-808a-686f840d28a0 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-e42c6bd3-1473-4ebc-bcda-d05300dcef0f-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-56e25142-b09c-425b-8051-52aa3eff47e4" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[664deaa6-8397-423a-88c4-cf6bcf0d1ce0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:06 devstack sudo[111844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 Aug 26 00:22:06 devstack sudo[111844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:07 devstack sudo[111844]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:07 devstack sudo[111849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4 Aug 26 00:22:07 devstack sudo[111849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:07 devstack sudo[111849]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-56e25142-b09c-425b-8051-52aa3eff47e4" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-56e25142-b09c-425b-8051-52aa3eff47e4" released by "delete_volume" :: held 0.666s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['89d91e37-cf36-4adb-81d9-e57b7094868e', '5566422f-d006-451e-8342-6b4021613c0b', 'ded5ab87-979e-4a8d-8a08-c067b2c9aad6', '9963c6bb-2f88-4fa4-a977-8cf1a1bb4fae'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Creating offline snapshot 8a399338-58ea-4582-bef8-dda6f7de4bf7 of volume 9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:22:07 devstack sudo[111859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:07 devstack sudo[111859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[40970e04-33c4-4ff8-9aac-668342985bad]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:07 devstack sudo[111861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d Aug 26 00:22:07 devstack sudo[111861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-1d422ce1-d24d-496f-8e5e-f5d69da9348a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:07 devstack sudo[111859]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-1d422ce1-d24d-496f-8e5e-f5d69da9348a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c468fbd0-0379-464b-ada5-e4db7b84b103 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-56e25142-b09c-425b-8051-52aa3eff47e4-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-1d422ce1-d24d-496f-8e5e-f5d69da9348a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-1d422ce1-d24d-496f-8e5e-f5d69da9348a" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[067d3ff3-b3bf-4a32-877f-171a089dddd6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111861]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d" returned: 0 in 0.421s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 2G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a Aug 26 00:22:08 devstack sudo[111864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:08 devstack sudo[111868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 2G Aug 26 00:22:08 devstack sudo[111868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:08 devstack sudo[111864]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a" returned: 0 in 0.369s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a Aug 26 00:22:08 devstack sudo[111877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:08 devstack sudo[111868]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 2G" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0b611e-a995-47fe-8f65-add357d4660d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0b611e-a995-47fe-8f65-add357d4660d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 Aug 26 00:22:08 devstack sudo[111880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:08 devstack sudo[111877]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d422ce1-d24d-496f-8e5e-f5d69da9348a" returned: 0 in 0.275s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-1d422ce1-d24d-496f-8e5e-f5d69da9348a" released by "delete_volume" :: held 0.683s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['fc066ed5-5809-4aa5-91f8-d66923b50ffa', '2b8c7cbb-d3d3-4129-a95d-b413a514c27d', 'd27513a4-6e6c-40e8-b048-2db661503b18', '7c3333aa-523f-4ffb-b082-8453245c6ef8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:08 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:08 devstack sudo[111880]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c0b611e-a995-47fe-8f65-add357d4660d -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7" returned: 0 in 0.315s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:08 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 is being set with open permissions: ugo+rw Aug 26 00:22:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:08 devstack sudo[111888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 Aug 26 00:22:08 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:09 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:09 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-79ff1b77-f85c-48d6-9403-829e359996bb-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-79ff1b77-f85c-48d6-9403-829e359996bb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c35c53e5-ffd1-45d7-8e86-d62a4697c558 tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-1d422ce1-d24d-496f-8e5e-f5d69da9348a-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "cinder-quobyte-79ff1b77-f85c-48d6-9403-829e359996bb" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:09 devstack sudo[111892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info Aug 26 00:22:09 devstack sudo[111892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-79ff1b77-f85c-48d6-9403-829e359996bb" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ec4ff-e003-4831-85a7-a689c9ce5c77]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:09 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb Aug 26 00:22:09 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:09 devstack sudo[111892]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info is being set with open permissions: ugo+rw Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:09 devstack sudo[111897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info Aug 26 00:22:09 devstack sudo[111897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:09 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb" returned: 0 in 0.371s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:09 devstack sudo[111902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb Aug 26 00:22:09 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:09 devstack sudo[111897]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.info" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-993d80d2-88ad-42e5-ae82-af26cd4c0842 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Create snapshot completed successfully Aug 26 00:22:09 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-79ff1b77-f85c-48d6-9403-829e359996bb" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-quobyte-79ff1b77-f85c-48d6-9403-829e359996bb" released by "delete_volume" :: held 0.682s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:09 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Created reservations ['b10a8447-c7bb-4514-a161-ebfbb3d5a8cd', '7544f66d-d58b-47e2-9f4c-7138e614f427', '6a5d67fa-fa44-4bc5-94fb-d7ca105da82f', '88ed87dd-85bd-49eb-8c73-a2601cb0dc6f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:10 devstack sudo[111906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:10 devstack sudo[111906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:10 devstack sudo[111906]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Deleted volume successfully. Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be6ce451-0263-41f9-af93-c9d1b9c037eb tempest-CreateVolumesFromSourceVolumeTest-2036086518 None] Lock "cinder-79ff1b77-f85c-48d6-9403-829e359996bb-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "cinder-8a399338-58ea-4582-bef8-dda6f7de4bf7-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-8a399338-58ea-4582-bef8-dda6f7de4bf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "cinder-quobyte-8a399338-58ea-4582-bef8-dda6f7de4bf7" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-8a399338-58ea-4582-bef8-dda6f7de4bf7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Deleting offline snapshot 8a399338-58ea-4582-bef8-dda6f7de4bf7 of volume 9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:22:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] snapshot_file for this snap is: volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2be387-a4e4-48ff-9d66-b34521554929]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:11 devstack sudo[111909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 Aug 26 00:22:11 devstack sudo[111909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:11 devstack sudo[111909]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7" returned: 0 in 0.384s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c0b611e-a995-47fe-8f65-add357d4660d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[654284d9-d70c-4918-a807-44e1e591512a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:11 devstack sudo[111914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d Aug 26 00:22:11 devstack sudo[111914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:11 devstack sudo[111914]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d" returned: 0 in 0.389s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:11 devstack sudo[111919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 Aug 26 00:22:11 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:12 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7" returned: 0 in 0.354s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:12 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7 Aug 26 00:22:12 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:12 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d.8a399338-58ea-4582-bef8-dda6f7de4bf7" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-8a399338-58ea-4582-bef8-dda6f7de4bf7" released by "_delete_snapshot" :: held 1.533s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" released by "delete_snapshot" :: held 1.570s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Created reservations ['5c86a94e-31d5-4ac2-a8cc-31cd8dec3d75', '7bef1985-f3ef-45f4-921c-839c1aaa69b3', '96f976e5-13e6-472e-8c42-dc9efebc3d2d', '5d9cd75e-75d3-42fd-b358-84947180ebda'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Delete snapshot completed successfully. Aug 26 00:22:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-35d82ff7-fa35-42fe-937c-e4c72453181c tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-8a399338-58ea-4582-bef8-dda6f7de4bf7-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "cinder-9c0b611e-a995-47fe-8f65-add357d4660d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-9c0b611e-a995-47fe-8f65-add357d4660d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Flow 'volume_create_manager' (66be1203-46fa-4b24-bad7-878ce43ce876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1117dd8-3143-4d4f-9160-632b35ef8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1117dd8-3143-4d4f-9160-632b35ef8168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-212680959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d1aaa2-e1e1-4b76-b018-a202c39a220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573799f295440faad7af16a99a22ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:13Z,use_quota=True,user_id='307a9afb66574360ad459596170c7390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff85bacc-f902-460c-a32e-8c5ef63d5121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff85bacc-f902-460c-a32e-8c5ef63d5121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840cd943-8a13-4ca2-a068-e6c06599c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (840cd943-8a13-4ca2-a068-e6c06599c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d1aaa2-e1e1-4b76-b018-a202c39a220b', 'volume_name': 'volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214c888a-acb1-47cb-9fe3-47cce166f49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (214c888a-acb1-47cb-9fe3-47cce166f49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee31c3-eb84-4a17-a59e-003a0fb0c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:13 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Volume 35d1aaa2-e1e1-4b76-b018-a202c39a220b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b', 'volume_size': 1} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-212680959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d1aaa2-e1e1-4b76-b018-a202c39a220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573799f295440faad7af16a99a22ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:13Z,use_quota=True,user_id='307a9afb66574360ad459596170c7390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Creating volume 35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:13 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:13 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b 1073741824 Aug 26 00:22:13 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3fefb3-5a5c-4d84-94ac-04aeb75d75d3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:13 devstack sudo[111930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d Aug 26 00:22:13 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:13 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b 1073741824" returned: 0 in 0.415s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:13 devstack sudo[111939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:13 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:13 devstack sudo[111939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:13 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d Aug 26 00:22:13 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:13 devstack sudo[111939]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45ee31c3-eb84-4a17-a59e-003a0fb0c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431c35c3-189a-4535-b6d1-540b0c1d15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Volume volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b (35d1aaa2-e1e1-4b76-b018-a202c39a220b): created successfully Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431c35c3-189a-4535-b6d1-540b0c1d15a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:14 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Flow 'volume_create_manager' (66be1203-46fa-4b24-bad7-878ce43ce876) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9c0b611e-a995-47fe-8f65-add357d4660d" returned: 0 in 0.275s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-quobyte-9c0b611e-a995-47fe-8f65-add357d4660d" released by "delete_volume" :: held 0.728s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8d16e2a0-0a75-4cc1-b3fb-7e4813ffa9fe tempest-VolumeDependencyTests-662479048 None] Created volume successfully. Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Created reservations ['118f2798-1326-4c49-84cd-c5ddecf87be2', 'dd273ff8-a5d5-41da-a228-30ce84a67240', 'ca14ffa1-a7a4-4394-ad29-e097b9f2e8f5', 'b8ddc87b-920e-45cc-ba75-2ab8e4cb8d62'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:14 devstack sudo[111945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:14 devstack sudo[111945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Creating offline snapshot 4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 of volume 35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3652ebbb-c42b-4a17-a12b-652c4a49edc8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:14 devstack sudo[111945]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.303s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Deleted volume successfully. Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-4f7d8007-c9f6-4e26-81fb-925d3438a4b6 tempest-VolumesSnapshotNegativeTestJSON-1147341558 None] Lock "cinder-9c0b611e-a995-47fe-8f65-add357d4660d-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:14 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:14 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:14 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.414s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:14 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 1G Aug 26 00:22:14 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:15 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 1G" returned: 0 in 0.473s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:15 devstack sudo[111958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:15 devstack sudo[111958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:15 devstack sudo[111958]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.342s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:15 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 is being set with open permissions: ugo+rw Aug 26 00:22:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:15 devstack sudo[111963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:15 devstack sudo[111963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:15 devstack sudo[111963]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:16 devstack sudo[111966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info Aug 26 00:22:16 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:16 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:16 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info is being set with open permissions: ugo+rw Aug 26 00:22:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:16 devstack sudo[111969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info Aug 26 00:22:16 devstack sudo[111969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:16 devstack sudo[111969]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.info" returned: 0 in 0.278s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f778cd0f-abc1-4b9c-b30d-df240579e27a tempest-VolumeDependencyTests-662479048 None] Create snapshot completed successfully Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Flow 'volume_create_manager' (e1eee64b-75cb-4978-a9a2-e59235e5c3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ea9bc-98c8-4b7c-b19d-bc4639282665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2ea9bc-98c8-4b7c-b19d-bc4639282665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-174848948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea225267-aaa7-44e7-a94e-1fb94640b547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9573799f295440faad7af16a99a22ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4bf0ca3f-ca72-45c5-819e-2aff16e3eb40,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:18Z,use_quota=True,user_id='307a9afb66574360ad459596170c7390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6103b929-c1cb-4ffb-ad05-43796855c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6103b929-c1cb-4ffb-ad05-43796855c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c195c947-31d8-4a1a-9982-7a52326ea140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c195c947-31d8-4a1a-9982-7a52326ea140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea225267-aaa7-44e7-a94e-1fb94640b547', 'volume_name': 'volume-ea225267-aaa7-44e7-a94e-1fb94640b547', 'volume_size': 1, 'snapshot_id': '4bf0ca3f-ca72-45c5-819e-2aff16e3eb40'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca99fc40-8d19-4216-9b83-3800a10a8cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca99fc40-8d19-4216-9b83-3800a10a8cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013213ff-3b58-4c32-b064-f7e9ab484fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Volume ea225267-aaa7-44e7-a94e-1fb94640b547: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea225267-aaa7-44e7-a94e-1fb94640b547', 'volume_size': 1, 'snapshot_id': '4bf0ca3f-ca72-45c5-819e-2aff16e3eb40'} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-ea225267-aaa7-44e7-a94e-1fb94640b547" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-ea225267-aaa7-44e7-a94e-1fb94640b547" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Creating volume ea225267-aaa7-44e7-a94e-1fb94640b547 from snapshot 4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] snapshot: 4bf0ca3f-ca72-45c5-819e-2aff16e3eb40, volume: ea225267-aaa7-44e7-a94e-1fb94640b547, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b5e85-de18-4e6b-810e-260ac8c905a4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:18 devstack sudo[111973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:18 devstack sudo[111973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:18 devstack sudo[111973]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e398acca-7060-4f72-b2fe-aaae7b23c46f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:18 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:18 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:19 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.390s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:22:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:22:19 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:22:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:19 devstack sudo[111983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 Aug 26 00:22:19 devstack sudo[111983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:23 devstack sudo[111983]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547" returned: 0 in 4.869s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:22:24 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Converted 1024.00 MB image at 210.25 MB/s Aug 26 00:22:24 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 is being set with open permissions: ugo+rw Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:24 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 Aug 26 00:22:24 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:24 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" released by "_copy_volume_from_snapshot" :: held 5.962s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-ea225267-aaa7-44e7-a94e-1fb94640b547" released by "_create_volume_from_snapshot" :: held 6.025s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.043s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013213ff-3b58-4c32-b064-f7e9ab484fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea225267-aaa7-44e7-a94e-1fb94640b547', 'volume_size': 1, 'snapshot_id': '4bf0ca3f-ca72-45c5-819e-2aff16e3eb40'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3a3a51-fac0-449e-8db6-72af02864d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:24 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Volume volume-ea225267-aaa7-44e7-a94e-1fb94640b547 (ea225267-aaa7-44e7-a94e-1fb94640b547): created successfully Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3a3a51-fac0-449e-8db6-72af02864d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Flow 'volume_create_manager' (e1eee64b-75cb-4978-a9a2-e59235e5c3a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-19c63ed1-1dbe-4605-9b2e-8627e14d51cb tempest-VolumeDependencyTests-662479048 None] Created volume successfully. Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Deleting offline snapshot 4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 of volume 35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] snapshot_file for this snap is: volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4169b6-a67e-4d35-9c44-fdbb8effa8e8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:25 devstack sudo[112000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:25 devstack sudo[112000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:25 devstack sudo[112000]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b008f40-57f4-43d1-9f26-ca74899cad2b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:25 devstack sudo[112005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:25 devstack sudo[112005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:25 devstack sudo[112005]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.542s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:25 devstack sudo[112011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:25 devstack sudo[112011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:26 devstack sudo[112011]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:26 devstack sudo[112016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40 Aug 26 00:22:26 devstack sudo[112016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:26 devstack sudo[112016]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b.4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" returned: 0 in 0.305s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40" released by "_delete_snapshot" :: held 1.681s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" released by "delete_snapshot" :: held 1.708s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Created reservations ['70bc66cc-7ea7-4b2d-911d-e127e5c74698', '218af2df-b29d-4d30-844f-fb5682286e9f', '2aa5b0ba-918f-40aa-a033-41ccfd6a4a5d', '01eeb8eb-e23f-45a2-a3c2-8165d475a1cc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Delete snapshot completed successfully. Aug 26 00:22:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fcf54e6e-e315-4312-9068-885b4361a6d8 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-4bf0ca3f-ca72-45c5-819e-2aff16e3eb40-delete_snapshot" released by "delete_snapshot" :: held 1.880s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-35d1aaa2-e1e1-4b76-b018-a202c39a220b-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-35d1aaa2-e1e1-4b76-b018-a202c39a220b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37c8fe-48d5-43ae-92f5-06bd93cce0af]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:27 devstack sudo[112019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:27 devstack sudo[112019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:27 devstack sudo[112019]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.365s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:27 devstack sudo[112024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b Aug 26 00:22:27 devstack sudo[112024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:27 devstack sudo[112024]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-35d1aaa2-e1e1-4b76-b018-a202c39a220b" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-35d1aaa2-e1e1-4b76-b018-a202c39a220b" released by "delete_volume" :: held 0.702s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Created reservations ['ea9aea47-f918-4420-b246-efea3ec187a2', '82702053-0c42-4961-8aa3-c498858390dc', '1a930e9e-3d64-4b70-b85d-cb76855b8244', '63803e78-c6a0-4984-a6c8-84333f07fda1'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:28 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:28 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:28 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-ea225267-aaa7-44e7-a94e-1fb94640b547-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Deleted volume successfully. Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "cinder-ea225267-aaa7-44e7-a94e-1fb94640b547-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e3d989d-dfbb-4931-a1e7-8eabadb008b9 tempest-VolumeDependencyTests-662479048 None] Lock "cinder-35d1aaa2-e1e1-4b76-b018-a202c39a220b-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Acquiring lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" acquired by "delete_volume" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e82c2-8eb8-4407-9abc-46081b5afe3e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:28 devstack sudo[112031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 Aug 26 00:22:28 devstack sudo[112031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:28 devstack sudo[112031]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:29 devstack sudo[112036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547 Aug 26 00:22:29 devstack sudo[112036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:29 devstack sudo[112036]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ea225267-aaa7-44e7-a94e-1fb94640b547" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "cinder-quobyte-ea225267-aaa7-44e7-a94e-1fb94640b547" released by "delete_volume" :: held 0.764s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Created reservations ['ab10e716-2fda-4bba-ab89-9bf6ca273946', '86116a12-1ade-4c9c-9c14-d5e82f9a6cb0', '6fa9b665-2f79-4887-b17a-ef8fad9c28b9', 'd02f6580-8159-4ea0-9e2b-f25cc5930018'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:29 devstack sudo[112039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:29 devstack sudo[112039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:29 devstack sudo[112039]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.311s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Deleted volume successfully. Aug 26 00:22:29 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-aa002ce9-dbee-48dc-9b5c-7cc3d3d42dda tempest-VolumeDependencyTests-662479048 None] Lock "cinder-ea225267-aaa7-44e7-a94e-1fb94640b547-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Flow 'volume_create_manager' (a3e26a85-75cd-4e9a-b188-57fff7331c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b660b02-926d-43bd-b93f-ba3aca864d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b660b02-926d-43bd-b93f-ba3aca864d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a204b3-aac8-4e8c-b239-3b8513033e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f1f7fd532b467fb7394e6c80e9c2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:35Z,use_quota=True,user_id='6ae6d809ddf14622b74dbb418303b548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f888d9-aa47-4a38-84a0-ed48c38cda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f888d9-aa47-4a38-84a0-ed48c38cda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f5dac3-3d7d-459f-b4b7-4a1ab89ac7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2f5dac3-3d7d-459f-b4b7-4a1ab89ac7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43a204b3-aac8-4e8c-b239-3b8513033e4a', 'volume_name': 'volume-43a204b3-aac8-4e8c-b239-3b8513033e4a', 'volume_size': 1, 'image_id': '241337c2-9216-484c-98d5-809d6e737af6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6d4ddd8e0dd57ece0c80d342074d7ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6f1f7fd532b467fb7394e6c80e9c2d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b72d7beea77bda187b727bbab188cbedb1458a2dcd186b4d396f57daf7ad51ee78fd5a5a75f2ce795309c1f3b463f6994729268dacdc516dadbef7f274046453', 'id': '241337c2-9216-484c-98d5-809d6e737af6', 'created_at': datetime.datetime(2026, 8, 25, 22, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/241337c2-9216-484c-98d5-809d6e737af6/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf7d33e-ef7b-4ea0-bd85-1f44ee833f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf7d33e-ef7b-4ea0-bd85-1f44ee833f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a9ce2-86f6-465a-92e6-832c288f4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Volume 43a204b3-aac8-4e8c-b239-3b8513033e4a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43a204b3-aac8-4e8c-b239-3b8513033e4a', 'volume_size': 1, 'image_id': '241337c2-9216-484c-98d5-809d6e737af6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6d4ddd8e0dd57ece0c80d342074d7ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6f1f7fd532b467fb7394e6c80e9c2d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b72d7beea77bda187b727bbab188cbedb1458a2dcd186b4d396f57daf7ad51ee78fd5a5a75f2ce795309c1f3b463f6994729268dacdc516dadbef7f274046453', 'id': '241337c2-9216-484c-98d5-809d6e737af6', 'created_at': datetime.datetime(2026, 8, 25, 22, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/241337c2-9216-484c-98d5-809d6e737af6/file', 'properties': {}}, 'image_service': } Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Trying to clone 43a204b3-aac8-4e8c-b239-3b8513033e4a from image 241337c2-9216-484c-98d5-809d6e737af6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:22:35 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:22:35 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Image download 0.00 MB at 0.00 MB/s Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6601ee-2e32-4f93-8de0-7f5a85720b27]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:36 devstack sudo[112045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:36 devstack sudo[112045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:36 devstack sudo[112045]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 0 in 0.406s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:36 devstack sudo[112049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:36 devstack sudo[112049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:36 devstack sudo[112049]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Temporary image 241337c2-9216-484c-98d5-809d6e737af6 is fetched for user 6ae6d809ddf14622b74dbb418303b548. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb126bf-d98f-4f2b-b298-cbc796f8ce10]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:37 devstack sudo[112054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:37 devstack sudo[112054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:37 devstack sudo[112054]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:37 devstack sudo[112058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:37 devstack sudo[112058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:37 devstack sudo[112058]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 1 in 0.330s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43a204b3-aac8-4e8c-b239-3b8513033e4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6f1f7fd532b467fb7394e6c80e9c2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:35Z,use_quota=True,user_id='6ae6d809ddf14622b74dbb418303b548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Creating volume 43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:37 devstack sudo[112063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1073741824 Aug 26 00:22:37 devstack sudo[112063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:38 devstack sudo[112063]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1073741824" returned: 0 in 0.456s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:38 devstack sudo[112070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a Aug 26 00:22:38 devstack sudo[112070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:38 devstack sudo[112070]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Attempting download of 241337c2-9216-484c-98d5-809d6e737af6 ((None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}])) to volume 43a204b3-aac8-4e8c-b239-3b8513033e4a. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65f1809-e075-4bfc-858e-a09a4f4be184]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:38 devstack sudo[112073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr Aug 26 00:22:38 devstack sudo[112073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:38 devstack sudo[112073]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:38 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr Aug 26 00:22:38 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:39 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr" returned: 1 in 0.381s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_241337c2-9216-484c-98d5-809d6e737af6_u97_czpr' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2a4119-b085-4487-8fd6-3fc21c630927]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:39 devstack sudo[112081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:39 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:39 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:39 devstack sudo[112085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD Aug 26 00:22:39 devstack sudo[112085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:39 devstack sudo[112085]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] 241337c2-9216-484c-98d5-809d6e737af6 was raw, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:22:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:39 devstack sudo[112090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a Aug 26 00:22:39 devstack sudo[112090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:40 devstack sudo[112090]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a" returned: 0 in 0.466s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_241337c2-9216-484c-98d5-809d6e737af6_b_ld9vyadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:22:40 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:40 devstack sudo[112096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1G Aug 26 00:22:40 devstack sudo[112096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:40 devstack sudo[112096]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a 1G" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Downloaded image 241337c2-9216-484c-98d5-809d6e737af6 ((None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}])) to volume 43a204b3-aac8-4e8c-b239-3b8513033e4a successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Temporary image 241337c2-9216-484c-98d5-809d6e737af6 for user 6ae6d809ddf14622b74dbb418303b548 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Marking volume 43a204b3-aac8-4e8c-b239-3b8513033e4a as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Copying metadata from image 241337c2-9216-484c-98d5-809d6e737af6 to 43a204b3-aac8-4e8c-b239-3b8513033e4a. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Creating volume glance metadata for volume 43a204b3-aac8-4e8c-b239-3b8513033e4a backed by image 241337c2-9216-484c-98d5-809d6e737af6 with: {'image_id': '241337c2-9216-484c-98d5-809d6e737af6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b6d4ddd8e0dd57ece0c80d342074d7ee', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671a9ce2-86f6-465a-92e6-832c288f4690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43a204b3-aac8-4e8c-b239-3b8513033e4a', 'volume_size': 1, 'image_id': '241337c2-9216-484c-98d5-809d6e737af6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/241337c2-9216-484c-98d5-809d6e737af6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6d4ddd8e0dd57ece0c80d342074d7ee', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b6f1f7fd532b467fb7394e6c80e9c2d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b72d7beea77bda187b727bbab188cbedb1458a2dcd186b4d396f57daf7ad51ee78fd5a5a75f2ce795309c1f3b463f6994729268dacdc516dadbef7f274046453', 'id': '241337c2-9216-484c-98d5-809d6e737af6', 'created_at': datetime.datetime(2026, 8, 25, 22, 22, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 22, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/241337c2-9216-484c-98d5-809d6e737af6/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3438b9-31ef-4c43-961b-792ea2c54157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:40 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Volume volume-43a204b3-aac8-4e8c-b239-3b8513033e4a (43a204b3-aac8-4e8c-b239-3b8513033e4a): created successfully Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a3438b9-31ef-4c43-961b-792ea2c54157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Flow 'volume_create_manager' (a3e26a85-75cd-4e9a-b188-57fff7331c69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-652cf393-bec5-457f-bfcd-76671c2938b7 tempest-VolumeImageDependencyTests-625796716 None] Created volume successfully. Aug 26 00:22:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Acquiring lock "cinder-43a204b3-aac8-4e8c-b239-3b8513033e4a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "cinder-43a204b3-aac8-4e8c-b239-3b8513033e4a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Acquiring lock "cinder-quobyte-43a204b3-aac8-4e8c-b239-3b8513033e4a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "cinder-quobyte-43a204b3-aac8-4e8c-b239-3b8513033e4a" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c332ce3-1a7d-4462-8175-012c9367abfc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:42 devstack sudo[112102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a Aug 26 00:22:42 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:42 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:42 devstack sudo[112110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a Aug 26 00:22:42 devstack sudo[112110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:42 devstack sudo[112110]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-43a204b3-aac8-4e8c-b239-3b8513033e4a" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "cinder-quobyte-43a204b3-aac8-4e8c-b239-3b8513033e4a" released by "delete_volume" :: held 0.709s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Created reservations ['2c265d2d-9520-4ca8-bbff-523ea71c95dd', 'a7eb3a2b-4d9a-4f7c-89d1-329da57c3670', '78260f0c-610d-45a1-bb6d-83b3e965616f', '664a02ce-1d83-4730-9f82-1fc67d48ff4a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:42 devstack sudo[112113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:42 devstack sudo[112113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:43 devstack sudo[112113]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:43 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Deleted volume successfully. Aug 26 00:22:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-90208573-933c-4fd1-ab19-c76b7b993027 tempest-VolumeImageDependencyTests-625796716 None] Lock "cinder-43a204b3-aac8-4e8c-b239-3b8513033e4a-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:46 devstack sudo[112145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:46 devstack sudo[112145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:46 devstack sudo[112145]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.336s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:22:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Flow 'volume_create_manager' (9b8f3b6b-60f2-47aa-8b1a-5742144051c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de9e292-9d8f-40c6-b124-3c3b38852b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de9e292-9d8f-40c6-b124-3c3b38852b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-950709590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c7593a-a605-443b-a913-dd04562f5e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a24a957b65489b812b450d402452e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:52Z,use_quota=True,user_id='c95e528ebb7c4cbfa4e618290e644353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879ccccb-a2a1-427c-928a-336cd8d38d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (879ccccb-a2a1-427c-928a-336cd8d38d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e7b3b6-83c4-4b21-89ad-c957f4e25ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e7b3b6-83c4-4b21-89ad-c957f4e25ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c7593a-a605-443b-a913-dd04562f5e2e', 'volume_name': 'volume-57c7593a-a605-443b-a913-dd04562f5e2e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f24a47-d05a-4ee4-a163-163da8238add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f24a47-d05a-4ee4-a163-163da8238add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2a87f5-2e94-4d13-9e0c-42a214ca8e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Volume 57c7593a-a605-443b-a913-dd04562f5e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c7593a-a605-443b-a913-dd04562f5e2e', 'volume_size': 1} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-950709590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c7593a-a605-443b-a913-dd04562f5e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83a24a957b65489b812b450d402452e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:52Z,use_quota=True,user_id='c95e528ebb7c4cbfa4e618290e644353',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Creating volume 57c7593a-a605-443b-a913-dd04562f5e2e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:52 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:52 devstack sudo[112231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e 1073741824 Aug 26 00:22:52 devstack sudo[112231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:52 devstack sudo[112231]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e 1073741824" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:52 devstack sudo[112236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e Aug 26 00:22:52 devstack sudo[112236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:53 devstack sudo[112236]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe2a87f5-2e94-4d13-9e0c-42a214ca8e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c7593a-a605-443b-a913-dd04562f5e2e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bc778a-54dc-43c1-b4b4-dc02f3cb2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Volume volume-57c7593a-a605-443b-a913-dd04562f5e2e (57c7593a-a605-443b-a913-dd04562f5e2e): created successfully Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0bc778a-54dc-43c1-b4b4-dc02f3cb2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Flow 'volume_create_manager' (9b8f3b6b-60f2-47aa-8b1a-5742144051c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-beda4b83-43c8-42d8-945d-8ac6639c1067 tempest-TestMinimumBasicScenario-1436710076 None] Created volume successfully. Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (0f6ef7bf-b4b3-4cc1-bf7e-31774ac8159c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec736f83-96ec-44b9-8005-82baf6363536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec736f83-96ec-44b9-8005-82baf6363536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136855739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c4195-8a61-4dc6-8bf0-b4a74e72df22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:54Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65717989-b18a-46dd-9e2a-4ff914a22cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65717989-b18a-46dd-9e2a-4ff914a22cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c70b56-c2e8-44bf-be2a-393981d7297a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9c70b56-c2e8-44bf-be2a-393981d7297a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '027c4195-8a61-4dc6-8bf0-b4a74e72df22', 'volume_name': 'volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a99b723-4bd8-406b-94fe-910648d906dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a99b723-4bd8-406b-94fe-910648d906dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd62232-0480-4820-943e-ac246ecaa160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Volume 027c4195-8a61-4dc6-8bf0-b4a74e72df22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22', 'volume_size': 1} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1136855739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=027c4195-8a61-4dc6-8bf0-b4a74e72df22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:54Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Creating volume 027c4195-8a61-4dc6-8bf0-b4a74e72df22 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:53 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:53 devstack sudo[112239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 1073741824 Aug 26 00:22:53 devstack sudo[112239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:54 devstack sudo[112239]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 1073741824" returned: 0 in 0.420s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:54 devstack sudo[112244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 Aug 26 00:22:54 devstack sudo[112244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:54 devstack sudo[112244]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd62232-0480-4820-943e-ac246ecaa160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a31a4c-d656-4ae9-8600-9f5b384bbcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:54 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Volume volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 (027c4195-8a61-4dc6-8bf0-b4a74e72df22): created successfully Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a31a4c-d656-4ae9-8600-9f5b384bbcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (0f6ef7bf-b4b3-4cc1-bf7e-31774ac8159c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-97d1ee06-ce5f-4126-b33f-25311139f0c6 tempest-ProjectReaderTests-2123263960 None] Created volume successfully. Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=101,cinder:INSERT=41,cinder:UPDATE=143,cinder:DELETE=12 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-027c4195-8a61-4dc6-8bf0-b4a74e72df22-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-027c4195-8a61-4dc6-8bf0-b4a74e72df22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:54 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=158,cinder:SELECT=119,cinder:INSERT=38,cinder:DELETE=14 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-quobyte-027c4195-8a61-4dc6-8bf0-b4a74e72df22" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-027c4195-8a61-4dc6-8bf0-b4a74e72df22" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0334f24d-db28-4f93-845d-6124c3a78cd2]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:55 devstack sudo[112250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 Aug 26 00:22:55 devstack sudo[112250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:55 devstack sudo[112250]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22" returned: 0 in 0.552s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:55 devstack sudo[112272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22 Aug 26 00:22:55 devstack sudo[112272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-93fd7888-4a7f-4457-9f68-fc4ec2088953 req-f4cdafc4-eeec-4ad7-a259-754ec3767411 tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-93fd7888-4a7f-4457-9f68-fc4ec2088953 req-f4cdafc4-eeec-4ad7-a259-754ec3767411 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-93fd7888-4a7f-4457-9f68-fc4ec2088953 req-f4cdafc4-eeec-4ad7-a259-754ec3767411 tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:55 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-93fd7888-4a7f-4457-9f68-fc4ec2088953 req-f4cdafc4-eeec-4ad7-a259-754ec3767411 tempest-TestMinimumBasicScenario-1436710076 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-57c7593a-a605-443b-a913-dd04562f5e2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4583ff5e-caab-4d6a-9c9e-4220685c3e12', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:22:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-93fd7888-4a7f-4457-9f68-fc4ec2088953 req-f4cdafc4-eeec-4ad7-a259-754ec3767411 tempest-TestMinimumBasicScenario-1436710076 None] attachment_update completed successfully. Aug 26 00:22:56 devstack sudo[112272]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-027c4195-8a61-4dc6-8bf0-b4a74e72df22" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-027c4195-8a61-4dc6-8bf0-b4a74e72df22" released by "delete_volume" :: held 0.976s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Created reservations ['e7313c4a-31cc-472b-8455-15ed88a8142f', '63a6bf9c-56da-441c-82b2-da728b47b4b5', 'd16d2ae2-6518-4ef3-94af-901f0fc1e05b', '52aabd9e-3fcf-4745-bd9f-0e3db1832303'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:56 devstack sudo[112323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:22:56 devstack sudo[112323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:56 devstack sudo[112323]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.311s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:22:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Deleted volume successfully. Aug 26 00:22:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0dcb8318-122b-480b-9433-a6011ababb76 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-027c4195-8a61-4dc6-8bf0-b4a74e72df22-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (e987ffde-271e-4ae6-9bf4-69af8c38bf26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560098e7-fcf6-429f-87a7-e71a9f63b65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560098e7-fcf6-429f-87a7-e71a9f63b65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387913615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe118e01-94b6-4688-9565-060672ecc5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:58Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c87099e-9aac-4a51-8ec4-3e825983eded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c87099e-9aac-4a51-8ec4-3e825983eded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bc2c81-3458-4e93-8469-308f43019ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bc2c81-3458-4e93-8469-308f43019ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe118e01-94b6-4688-9565-060672ecc5e2', 'volume_name': 'volume-fe118e01-94b6-4688-9565-060672ecc5e2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb5b814-a86f-40e0-bb56-9f6e8aec279f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb5b814-a86f-40e0-bb56-9f6e8aec279f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d2791d-b64f-4fd8-9686-95d271a0d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:57 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Volume fe118e01-94b6-4688-9565-060672ecc5e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe118e01-94b6-4688-9565-060672ecc5e2', 'volume_size': 1} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1387913615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe118e01-94b6-4688-9565-060672ecc5e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:22:58Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Creating volume fe118e01-94b6-4688-9565-060672ecc5e2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:22:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:22:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:57 devstack sudo[112665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 1073741824 Aug 26 00:22:57 devstack sudo[112665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:58 devstack sudo[112665]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 1073741824" returned: 0 in 0.459s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:22:58 devstack sudo[112670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 Aug 26 00:22:58 devstack sudo[112670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:22:58 devstack sudo[112670]: pam_unix(sudo:session): session closed for user root Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2" returned: 0 in 0.302s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d2791d-b64f-4fd8-9686-95d271a0d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe118e01-94b6-4688-9565-060672ecc5e2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e0acc6-a737-4f1c-8a30-a319dd5683d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:22:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Volume volume-fe118e01-94b6-4688-9565-060672ecc5e2 (fe118e01-94b6-4688-9565-060672ecc5e2): created successfully Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e0acc6-a737-4f1c-8a30-a319dd5683d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:22:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (e987ffde-271e-4ae6-9bf4-69af8c38bf26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:22:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-15e76844-0320-4540-beb5-919144020995 tempest-ProjectReaderTests-2123263960 None] Created volume successfully. Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-fe118e01-94b6-4688-9565-060672ecc5e2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-fe118e01-94b6-4688-9565-060672ecc5e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-quobyte-fe118e01-94b6-4688-9565-060672ecc5e2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-fe118e01-94b6-4688-9565-060672ecc5e2" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb15a1-b5f8-478f-bc14-fa922664b5a4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:22:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:00 devstack sudo[112673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 Aug 26 00:23:00 devstack sudo[112673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:00 devstack sudo[112673]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2" returned: 0 in 0.492s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:00 devstack sudo[112679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2 Aug 26 00:23:00 devstack sudo[112679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:00 devstack sudo[112679]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fe118e01-94b6-4688-9565-060672ecc5e2" returned: 0 in 0.329s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-fe118e01-94b6-4688-9565-060672ecc5e2" released by "delete_volume" :: held 0.892s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:00 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Created reservations ['9ecf5483-6394-4c44-9522-43825537ec42', '6b328742-76be-481a-9786-cb94a995dc67', 'a6752d42-e87d-4b50-8a1e-e8769211dc04', 'ef51c5fe-7a75-4933-aeb7-df1c5fe92e83'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:01 devstack sudo[112683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:23:01 devstack sudo[112683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:01 devstack sudo[112683]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.614s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:23:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Deleted volume successfully. Aug 26 00:23:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-275bc99d-b63a-4073-bf81-f8ff288cbf49 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-fe118e01-94b6-4688-9565-060672ecc5e2-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (5f42cb85-027a-4c9c-a527-01cdb2d83068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abdfda1-5edb-4a5f-aacc-c031895b4495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abdfda1-5edb-4a5f-aacc-c031895b4495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144977171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbe065-60c6-4afb-88df-80f785d38b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:23:02Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e99b11-813b-4cc9-b181-4d62134d64ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e99b11-813b-4cc9-b181-4d62134d64ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badc72e1-d16a-4738-9d8f-0230f2a3cd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badc72e1-d16a-4738-9d8f-0230f2a3cd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcbe065-60c6-4afb-88df-80f785d38b4e', 'volume_name': 'volume-9bcbe065-60c6-4afb-88df-80f785d38b4e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a25593-7a55-4ce8-8264-255e81e427ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a25593-7a55-4ce8-8264-255e81e427ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c045fca4-e011-4805-9d84-45f8070eecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Volume 9bcbe065-60c6-4afb-88df-80f785d38b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcbe065-60c6-4afb-88df-80f785d38b4e', 'volume_size': 1} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1144977171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bcbe065-60c6-4afb-88df-80f785d38b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:23:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:23:02Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Creating volume 9bcbe065-60c6-4afb-88df-80f785d38b4e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:23:02 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:02 devstack sudo[112722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e 1073741824 Aug 26 00:23:02 devstack sudo[112722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:02 devstack sudo[112722]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e 1073741824" returned: 0 in 0.579s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:02 devstack sudo[112754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e Aug 26 00:23:02 devstack sudo[112754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:03 devstack sudo[112754]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c045fca4-e011-4805-9d84-45f8070eecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcbe065-60c6-4afb-88df-80f785d38b4e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafb8c6-c76c-4bd6-9c98-c9f30c8a2df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:03 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Volume volume-9bcbe065-60c6-4afb-88df-80f785d38b4e (9bcbe065-60c6-4afb-88df-80f785d38b4e): created successfully Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aafb8c6-c76c-4bd6-9c98-c9f30c8a2df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:03 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (5f42cb85-027a-4c9c-a527-01cdb2d83068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:23:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-cfe3ca59-3ae4-4796-956c-e0b7bf05f841 tempest-ProjectReaderTests-2123263960 None] Created volume successfully. Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-9bcbe065-60c6-4afb-88df-80f785d38b4e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-9bcbe065-60c6-4afb-88df-80f785d38b4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-quobyte-9bcbe065-60c6-4afb-88df-80f785d38b4e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-9bcbe065-60c6-4afb-88df-80f785d38b4e" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0977e34-90ed-4926-8067-1fff97fd00be]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:04 devstack sudo[112758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e Aug 26 00:23:04 devstack sudo[112758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:04 devstack sudo[112758]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e" returned: 0 in 0.373s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:04 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e Aug 26 00:23:04 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:04 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9bcbe065-60c6-4afb-88df-80f785d38b4e" returned: 0 in 0.244s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-9bcbe065-60c6-4afb-88df-80f785d38b4e" released by "delete_volume" :: held 0.660s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Created reservations ['8678343e-5b08-44cc-bd06-decebd84f7b9', '0b98309e-b1b2-4938-ba0e-fa504dd9e37a', 'aef066ab-e441-4cd8-a190-d915f8ea92e7', '999c6094-a841-41bb-97ea-919c17886524'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:05 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:23:05 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:05 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:23:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Deleted volume successfully. Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ddc466c8-c0d4-4c91-8ef2-0cf93810ced0 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-9bcbe065-60c6-4afb-88df-80f785d38b4e-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (8a6faf9c-54ac-47a2-bcde-ab44c449aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f612008f-5c7a-4b0b-a0d2-95eff262ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f612008f-5c7a-4b0b-a0d2-95eff262ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915622786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51475267-5f38-4cec-bb17-ac3c57ebd28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:23:06Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d339c909-eafc-4d80-be0a-1b8e5ab3403a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d339c909-eafc-4d80-be0a-1b8e5ab3403a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16887341-f54e-45e9-bf15-285c289c1949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16887341-f54e-45e9-bf15-285c289c1949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51475267-5f38-4cec-bb17-ac3c57ebd28e', 'volume_name': 'volume-51475267-5f38-4cec-bb17-ac3c57ebd28e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4ca1ac-7a05-414c-9a66-6a57b35fa0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4ca1ac-7a05-414c-9a66-6a57b35fa0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50804b05-ac16-4ca1-ab2f-438cc10092fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:05 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Volume 51475267-5f38-4cec-bb17-ac3c57ebd28e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51475267-5f38-4cec-bb17-ac3c57ebd28e', 'volume_size': 1} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915622786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51475267-5f38-4cec-bb17-ac3c57ebd28e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035cad85b7ad4b57b4e911318d44cdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:23:06Z,use_quota=True,user_id='58c13687ea8344438182f5c73946a574',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Creating volume 51475267-5f38-4cec-bb17-ac3c57ebd28e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:23:05 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:23:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:05 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e 1073741824 Aug 26 00:23:05 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:06 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e 1073741824" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:06 devstack sudo[112774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e Aug 26 00:23:06 devstack sudo[112774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:06 devstack sudo[112774]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e" returned: 0 in 0.236s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50804b05-ac16-4ca1-ab2f-438cc10092fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51475267-5f38-4cec-bb17-ac3c57ebd28e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c6f9ef-f400-4300-8b45-16b4c9b500fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:23:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Volume volume-51475267-5f38-4cec-bb17-ac3c57ebd28e (51475267-5f38-4cec-bb17-ac3c57ebd28e): created successfully Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c6f9ef-f400-4300-8b45-16b4c9b500fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Flow 'volume_create_manager' (8a6faf9c-54ac-47a2-bcde-ab44c449aa37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:23:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c7f2919e-2a73-4afa-9c80-33b50d38bf1b tempest-ProjectReaderTests-2123263960 None] Created volume successfully. Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-51475267-5f38-4cec-bb17-ac3c57ebd28e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-51475267-5f38-4cec-bb17-ac3c57ebd28e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "cinder-quobyte-51475267-5f38-4cec-bb17-ac3c57ebd28e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-51475267-5f38-4cec-bb17-ac3c57ebd28e" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c58e0d-8b34-4cb2-ba1f-e09606bd9d14]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:23:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:06 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e Aug 26 00:23:06 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:07 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:07 devstack sudo[112782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e Aug 26 00:23:07 devstack sudo[112782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:07 devstack sudo[112782]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-51475267-5f38-4cec-bb17-ac3c57ebd28e" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-quobyte-51475267-5f38-4cec-bb17-ac3c57ebd28e" released by "delete_volume" :: held 0.626s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Created reservations ['f3b70f9b-6174-467c-bb63-708477018225', '11311e49-eecb-42d4-ae2e-8be679f57816', '676778a6-b5fb-4354-a397-114ab60c942b', 'bc5df2f4-5739-473d-a3dd-ecffefd247e3'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:07 devstack sudo[112785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:23:07 devstack sudo[112785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:07 devstack sudo[112785]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:23:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Deleted volume successfully. Aug 26 00:23:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-fe00772a-8fc9-4607-a8a5-d1c6d2e3a250 tempest-ProjectReaderTests-2123263960 None] Lock "cinder-51475267-5f38-4cec-bb17-ac3c57ebd28e-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:17 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=33,cinder:UPDATE=48,cinder:INSERT=9,cinder:DELETE=2 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:23:17 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=37,cinder:SELECT=31,cinder:INSERT=10,cinder:DELETE=5 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:23:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-c0e60906-8267-4169-a965-e48aa1aa2ef4 req-b0db8df4-d7e6-4fdd-9c26-e850c1606ecd tempest-TestMinimumBasicScenario-1436710076 None] Terminate volume connection completed successfully. Aug 26 00:23:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-c0e60906-8267-4169-a965-e48aa1aa2ef4 req-b0db8df4-d7e6-4fdd-9c26-e850c1606ecd tempest-TestMinimumBasicScenario-1436710076 None] Deleting attachment 4583ff5e-caab-4d6a-9c9e-4220685c3e12. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:23:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "cinder-57c7593a-a605-443b-a913-dd04562f5e2e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "cinder-57c7593a-a605-443b-a913-dd04562f5e2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "cinder-quobyte-57c7593a-a605-443b-a913-dd04562f5e2e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "cinder-quobyte-57c7593a-a605-443b-a913-dd04562f5e2e" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8095115e-097d-4d4e-b6fa-19e534637b3b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:41 devstack sudo[112890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e Aug 26 00:23:41 devstack sudo[112890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:41 devstack sudo[112890]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e" returned: 0 in 0.358s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:41 devstack sudo[112895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e Aug 26 00:23:41 devstack sudo[112895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:41 devstack sudo[112895]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-57c7593a-a605-443b-a913-dd04562f5e2e" returned: 0 in 0.244s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "cinder-quobyte-57c7593a-a605-443b-a913-dd04562f5e2e" released by "delete_volume" :: held 0.638s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Created reservations ['78abe447-602e-48d8-bf53-352645088b48', 'dce25ddf-ad58-46ee-a1ab-038d0d43d267', '005b8fe9-83d7-4139-bfba-952ec8b9880c', '54cf322c-c718-4d57-b4be-fadd0e433770'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:41 devstack sudo[112898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:23:41 devstack sudo[112898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:41 devstack sudo[112898]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.235s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:41 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:23:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Deleted volume successfully. Aug 26 00:23:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1c597c40-daee-4ee5-9bc7-6dea86fd3b2b tempest-TestMinimumBasicScenario-1436710076 None] Lock "cinder-57c7593a-a605-443b-a913-dd04562f5e2e-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:23:46 devstack sudo[112931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:23:46 devstack sudo[112931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:23:46 devstack sudo[112931]: pam_unix(sudo:session): session closed for user root Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:23:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:23:51 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=5 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:23:51 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Flow 'volume_create_manager' (d767456f-023a-4b49-9e58-55a7904b500e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53017abb-98ae-436d-a68c-ab3ffb25b4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53017abb-98ae-436d-a68c-ab3ffb25b4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-412170085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd87683-f83f-47ae-ade8-7a3a28347bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3bb6c7fff24cd8a3f567c6d62ae146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:24:44Z,use_quota=True,user_id='c536e890676344529fca19dd020ba71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f696213-ceb5-41cc-ba70-37f119f8aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f696213-ceb5-41cc-ba70-37f119f8aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccce5050-1330-46d0-a36b-c8a1ac63ed8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccce5050-1330-46d0-a36b-c8a1ac63ed8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd87683-f83f-47ae-ade8-7a3a28347bdb', 'volume_name': 'volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83119a6-6907-4309-adb0-f71c9d897376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83119a6-6907-4309-adb0-f71c9d897376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4343c7c1-800c-43e9-80ac-935a8422d9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:43 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Volume 0fd87683-f83f-47ae-ade8-7a3a28347bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb', 'volume_size': 1} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-412170085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd87683-f83f-47ae-ade8-7a3a28347bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f3bb6c7fff24cd8a3f567c6d62ae146',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:24:44Z,use_quota=True,user_id='c536e890676344529fca19dd020ba71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Creating volume 0fd87683-f83f-47ae-ade8-7a3a28347bdb {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:24:43 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:24:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:44 devstack sudo[113112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb 1073741824 Aug 26 00:24:44 devstack sudo[113112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:44 devstack sudo[113112]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb 1073741824" returned: 0 in 0.416s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:44 devstack sudo[113117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb Aug 26 00:24:44 devstack sudo[113117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:44 devstack sudo[113117]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4343c7c1-800c-43e9-80ac-935a8422d9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42b22a3-0542-4d6b-bfb8-5ab4f6de308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:24:44 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Volume volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb (0fd87683-f83f-47ae-ade8-7a3a28347bdb): created successfully Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42b22a3-0542-4d6b-bfb8-5ab4f6de308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:24:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Flow 'volume_create_manager' (d767456f-023a-4b49-9e58-55a7904b500e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:24:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-21dcf35b-0231-40b2-a4c9-b6b08313ff83 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Created volume successfully. Aug 26 00:24:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-87e56290-e8ea-4382-a6c8-67f9890d4b08 req-9a7e5e1f-bef3-4f19-b0ec-e1f3eecdc29b tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:24:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-87e56290-e8ea-4382-a6c8-67f9890d4b08 req-9a7e5e1f-bef3-4f19-b0ec-e1f3eecdc29b tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:24:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [req-87e56290-e8ea-4382-a6c8-67f9890d4b08 req-9a7e5e1f-bef3-4f19-b0ec-e1f3eecdc29b tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:24:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-87e56290-e8ea-4382-a6c8-67f9890d4b08 req-9a7e5e1f-bef3-4f19-b0ec-e1f3eecdc29b tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9', 'name': 'volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ea4b2e2-0740-4c63-9dee-f36b70bff7de', 'enforce_multipath': True} {{(pid=94433) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 00:24:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-87e56290-e8ea-4382-a6c8-67f9890d4b08 req-9a7e5e1f-bef3-4f19-b0ec-e1f3eecdc29b tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] attachment_update completed successfully. Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:46 devstack sudo[113516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:24:46 devstack sudo[113516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:46 devstack sudo[113516]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:24:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:24:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [req-6b7e5f1d-3404-4216-b37a-9983bc45cfe2 req-1d19b428-6f8f-44c3-a607-9629d7d543a1 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Terminate volume connection completed successfully. Aug 26 00:24:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [req-6b7e5f1d-3404-4216-b37a-9983bc45cfe2 req-1d19b428-6f8f-44c3-a607-9629d7d543a1 tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Deleting attachment 3ea4b2e2-0740-4c63-9dee-f36b70bff7de. {{(pid=94433) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "cinder-0fd87683-f83f-47ae-ade8-7a3a28347bdb-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "cinder-0fd87683-f83f-47ae-ade8-7a3a28347bdb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "cinder-quobyte-0fd87683-f83f-47ae-ade8-7a3a28347bdb" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "cinder-quobyte-0fd87683-f83f-47ae-ade8-7a3a28347bdb" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98802f6-d9c8-4949-abb8-2e535387473c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:49 devstack sudo[113549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb Aug 26 00:24:49 devstack sudo[113549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:49 devstack sudo[113549]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:49 devstack sudo[113554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb Aug 26 00:24:49 devstack sudo[113554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:50 devstack sudo[113554]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0fd87683-f83f-47ae-ade8-7a3a28347bdb" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "cinder-quobyte-0fd87683-f83f-47ae-ade8-7a3a28347bdb" released by "delete_volume" :: held 0.638s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Created reservations ['4a8a2f66-d59b-4a5d-8deb-56ec25f2b0df', 'be069c9d-2f7d-4940-9d95-57a31ef4a4a2', 'c7d82807-a59f-44b0-af22-593625bcbcd9', '7a0f2d4b-b5e2-4b70-b89a-a40b2f0dc181'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:24:50 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:24:50 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:24:50 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:24:50 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Deleted volume successfully. Aug 26 00:24:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-45d6f8ac-884d-4311-992f-c7003dab4e9f tempest-TestServerVolumeAttachScenarioOldVersion-387857910 None] Lock "cinder-0fd87683-f83f-47ae-ade8-7a3a28347bdb-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:00 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=10,cinder:SELECT=15,cinder:INSERT=3,cinder:DELETE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:25:00 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (bf35d5fd-1f2b-4800-839e-08e603980971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfb9f17-d9a6-486c-8c76-e19dbfdfa94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfb9f17-d9a6-486c-8c76-e19dbfdfa94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131191668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1f36d3-5d04-45e6-bc97-20f01c58c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:07Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b379a4-b359-42aa-b8d5-404334d3424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b379a4-b359-42aa-b8d5-404334d3424f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfec05-3c40-4a3a-8ec7-d5426f45b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfec05-3c40-4a3a-8ec7-d5426f45b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1f36d3-5d04-45e6-bc97-20f01c58c47f', 'volume_name': 'volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697cf5e7-d2f2-4752-a61d-046dff0558d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697cf5e7-d2f2-4752-a61d-046dff0558d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb4734b-e76b-4e47-9cc3-b341115bb3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Volume 2e1f36d3-5d04-45e6-bc97-20f01c58c47f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f', 'volume_size': 1} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1131191668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1f36d3-5d04-45e6-bc97-20f01c58c47f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:07Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Creating volume 2e1f36d3-5d04-45e6-bc97-20f01c58c47f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:06 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:06 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f 1073741824 Aug 26 00:25:06 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (12b67995-6f80-412a-bfce-c59f8af2d8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ffdb36-2bc4-4c3c-86dc-cbb4c46e82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ffdb36-2bc4-4c3c-86dc-cbb4c46e82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092998702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20feabe5-3312-4dea-aa63-5906fe807ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:07Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c92bb0-dc41-4cdc-964e-19bbd60e6839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c92bb0-dc41-4cdc-964e-19bbd60e6839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a410d987-e8c7-42b7-9589-5b29e80a7aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a410d987-e8c7-42b7-9589-5b29e80a7aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20feabe5-3312-4dea-aa63-5906fe807ab2', 'volume_name': 'volume-20feabe5-3312-4dea-aa63-5906fe807ab2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3687287f-fe2b-46e4-8fa4-34cf3ad9de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3687287f-fe2b-46e4-8fa4-34cf3ad9de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215628b7-3c22-478f-b803-d2440a5da39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Volume 20feabe5-3312-4dea-aa63-5906fe807ab2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20feabe5-3312-4dea-aa63-5906fe807ab2', 'volume_size': 1} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:07 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f 1073741824" returned: 0 in 0.483s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:07 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f Aug 26 00:25:07 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (980bc61e-7305-4002-90c9-f8178acbd3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97243e3f-f378-4096-b59e-e6ffa6f86d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97243e3f-f378-4096-b59e-e6ffa6f86d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565277198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e9d406-4396-4f5d-8977-a144d9962f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43715840-ae0c-4e8c-ad8e-054bab08bf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43715840-ae0c-4e8c-ad8e-054bab08bf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f506eb8-67d7-4739-8003-ef45ddcea213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f506eb8-67d7-4739-8003-ef45ddcea213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e9d406-4396-4f5d-8977-a144d9962f36', 'volume_name': 'volume-60e9d406-4396-4f5d-8977-a144d9962f36', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d09695-1391-42f3-b614-09bdfd71f2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d09695-1391-42f3-b614-09bdfd71f2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4568dfb-0c7e-436f-9de5-faa3582bbbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Volume 60e9d406-4396-4f5d-8977-a144d9962f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e9d406-4396-4f5d-8977-a144d9962f36', 'volume_size': 1} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:07 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" returned: 0 in 0.266s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1092998702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20feabe5-3312-4dea-aa63-5906fe807ab2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:07Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Creating volume 20feabe5-3312-4dea-aa63-5906fe807ab2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:07 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fb4734b-e76b-4e47-9cc3-b341115bb3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6cae9d-dbc8-40fd-a147-e7641d3d8468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 1073741824 Aug 26 00:25:07 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Volume volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f (2e1f36d3-5d04-45e6-bc97-20f01c58c47f): created successfully Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6cae9d-dbc8-40fd-a147-e7641d3d8468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (bf35d5fd-1f2b-4800-839e-08e603980971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a9df55d0-94d9-4aeb-898b-0fa279dd1959 tempest-CreateVolumesFromImageTest-863931824 None] Created volume successfully. Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (e1b78d13-3b6a-4599-b7b7-9cc35a2015f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b623037-a376-4636-a3a7-86fa1949899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b623037-a376-4636-a3a7-86fa1949899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1238765525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d56e2c8-e599-4100-b5ff-ddead199bb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60654bb6-9b93-47ea-9826-76f864485867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60654bb6-9b93-47ea-9826-76f864485867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81999f-21e8-4832-9b1d-83627996a1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81999f-21e8-4832-9b1d-83627996a1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d56e2c8-e599-4100-b5ff-ddead199bb14', 'volume_name': 'volume-1d56e2c8-e599-4100-b5ff-ddead199bb14', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8100ec87-539b-4600-9192-db34272f16c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8100ec87-539b-4600-9192-db34272f16c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767b8444-9db4-49df-ada6-1b9c7d982625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Volume 1d56e2c8-e599-4100-b5ff-ddead199bb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d56e2c8-e599-4100-b5ff-ddead199bb14', 'volume_size': 1} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (d725397e-de45-4a9e-8507-cbcb1f978869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09312318-856b-41b2-95ec-8b87c3283646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 1073741824" returned: 0 in 0.567s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09312318-856b-41b2-95ec-8b87c3283646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560967082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51f88c7-842b-457a-a013-49a59222daed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaad3c87-a220-479c-a391-fbb752403bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaad3c87-a220-479c-a391-fbb752403bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98477c7-95ea-42b6-847a-1c8f9ae417e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98477c7-95ea-42b6-847a-1c8f9ae417e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51f88c7-842b-457a-a013-49a59222daed', 'volume_name': 'volume-c51f88c7-842b-457a-a013-49a59222daed', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e19e603-f63b-4482-bceb-08437670f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e19e603-f63b-4482-bceb-08437670f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2eb11-acd7-43ab-9e50-9e92c6ddefec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Volume c51f88c7-842b-457a-a013-49a59222daed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51f88c7-842b-457a-a013-49a59222daed', 'volume_size': 1} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:08 devstack sudo[114218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 Aug 26 00:25:08 devstack sudo[114218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:08 devstack sudo[114218]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2" returned: 0 in 0.236s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-565277198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e9d406-4396-4f5d-8977-a144d9962f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Creating volume 60e9d406-4396-4f5d-8977-a144d9962f36 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:08 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:08 devstack sudo[114221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 1073741824 Aug 26 00:25:08 devstack sudo[114221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215628b7-3c22-478f-b803-d2440a5da39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20feabe5-3312-4dea-aa63-5906fe807ab2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e93bd-380a-4566-a660-f0ae9ccae1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:08 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Volume volume-20feabe5-3312-4dea-aa63-5906fe807ab2 (20feabe5-3312-4dea-aa63-5906fe807ab2): created successfully Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263e93bd-380a-4566-a660-f0ae9ccae1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:08 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (12b67995-6f80-412a-bfce-c59f8af2d8ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:08 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-44214a2b-771c-4971-b2f5-2e0e39aa9745 tempest-CreateVolumesFromImageTest-863931824 None] Created volume successfully. Aug 26 00:25:09 devstack sudo[114221]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 1073741824" returned: 0 in 0.406s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:09 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 Aug 26 00:25:09 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:09 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36" returned: 0 in 0.246s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.304s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1238765525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d56e2c8-e599-4100-b5ff-ddead199bb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Creating volume 1d56e2c8-e599-4100-b5ff-ddead199bb14 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:09 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4568dfb-0c7e-436f-9de5-faa3582bbbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e9d406-4396-4f5d-8977-a144d9962f36', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:09 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 1073741824 Aug 26 00:25:09 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bb51c7-351c-4c0d-b4e6-7ba17a30785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Volume volume-60e9d406-4396-4f5d-8977-a144d9962f36 (60e9d406-4396-4f5d-8977-a144d9962f36): created successfully Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15bb51c7-351c-4c0d-b4e6-7ba17a30785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (980bc61e-7305-4002-90c9-f8178acbd3fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-006b7c3b-6ba2-428e-8e7e-806ed127392e tempest-CreateVolumesFromImageTest-863931824 None] Created volume successfully. Aug 26 00:25:09 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 1073741824" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:09 devstack sudo[114234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 Aug 26 00:25:09 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:10 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560967082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51f88c7-842b-457a-a013-49a59222daed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33c21b7bd9a4b8cbca1d627fe478ada',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:08Z,use_quota=True,user_id='e332ba851cb241c08c2a705712f349db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Creating volume c51f88c7-842b-457a-a013-49a59222daed {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:10 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767b8444-9db4-49df-ada6-1b9c7d982625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d56e2c8-e599-4100-b5ff-ddead199bb14', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:10 devstack sudo[114237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed 1073741824 Aug 26 00:25:10 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6c90a7-f1e9-4ff0-9b6f-bffaf5f3e26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Volume volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 (1d56e2c8-e599-4100-b5ff-ddead199bb14): created successfully Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6c90a7-f1e9-4ff0-9b6f-bffaf5f3e26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (e1b78d13-3b6a-4599-b7b7-9cc35a2015f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bbe0cb33-aae3-48d8-861b-57dd31f6c6a7 tempest-CreateVolumesFromImageTest-863931824 None] Created volume successfully. Aug 26 00:25:10 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed 1073741824" returned: 0 in 0.420s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:10 devstack sudo[114244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed Aug 26 00:25:10 devstack sudo[114244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:10 devstack sudo[114244]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed" returned: 0 in 0.235s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d2eb11-acd7-43ab-9e50-9e92c6ddefec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51f88c7-842b-457a-a013-49a59222daed', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b5836-8776-4274-84bc-ce4e1084e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Volume volume-c51f88c7-842b-457a-a013-49a59222daed (c51f88c7-842b-457a-a013-49a59222daed): created successfully Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (899b5836-8776-4274-84bc-ce4e1084e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Flow 'volume_create_manager' (d725397e-de45-4a9e-8507-cbcb1f978869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5a191045-9cc0-4006-92fc-9cd550df6a3f tempest-CreateVolumesFromImageTest-863931824 None] Created volume successfully. Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-c51f88c7-842b-457a-a013-49a59222daed-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-c51f88c7-842b-457a-a013-49a59222daed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-quobyte-c51f88c7-842b-457a-a013-49a59222daed" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-c51f88c7-842b-457a-a013-49a59222daed" acquired by "delete_volume" :: waited 0.013s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d79f9-966d-4b9b-9d85-38d02ae40090]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:11 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed Aug 26 00:25:11 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:12 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:12 devstack sudo[114252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed Aug 26 00:25:12 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:12 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c51f88c7-842b-457a-a013-49a59222daed" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-c51f88c7-842b-457a-a013-49a59222daed" released by "delete_volume" :: held 0.653s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Created reservations ['e9f56c82-5f83-4652-91ac-e4f3614154e4', '314048ff-e366-402d-a728-ff1487cf8bc1', '9b01cdd4-efc8-49bd-aae8-95ea4c0067d6', '53486faf-f9ed-42b4-a0c7-41efca6e9e31'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:12 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:12 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:12 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Deleted volume successfully. Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-43782653-d712-4bae-beae-ea77554552e5 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-c51f88c7-842b-457a-a013-49a59222daed-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-1d56e2c8-e599-4100-b5ff-ddead199bb14-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-1d56e2c8-e599-4100-b5ff-ddead199bb14-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-quobyte-1d56e2c8-e599-4100-b5ff-ddead199bb14" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-1d56e2c8-e599-4100-b5ff-ddead199bb14" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9da17a8-ae3c-454f-a1fc-e32fe4a1a52f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:13 devstack sudo[114258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 Aug 26 00:25:13 devstack sudo[114258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:13 devstack sudo[114258]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14" returned: 0 in 0.352s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:13 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14 Aug 26 00:25:13 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:13 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1d56e2c8-e599-4100-b5ff-ddead199bb14" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-1d56e2c8-e599-4100-b5ff-ddead199bb14" released by "delete_volume" :: held 0.631s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Created reservations ['ad68407d-09e4-4b1a-a0a7-d44b17e8f302', '6d8292c6-09d4-4e2c-bd2c-e8c8015c3494', '92483fc1-03aa-4ff1-964b-b0facb298bfa', '18274e7f-c223-49ce-bcc6-fd64e38bbca5'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:13 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:13 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:13 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.238s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Deleted volume successfully. Aug 26 00:25:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-087f9495-204c-44c2-ae14-eceb363c60c9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-1d56e2c8-e599-4100-b5ff-ddead199bb14-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-60e9d406-4396-4f5d-8977-a144d9962f36-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-60e9d406-4396-4f5d-8977-a144d9962f36-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-quobyte-60e9d406-4396-4f5d-8977-a144d9962f36" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-60e9d406-4396-4f5d-8977-a144d9962f36" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486deb4-1a2e-43b4-b85f-4750ebad9b4e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:14 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 Aug 26 00:25:14 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:14 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:14 devstack sudo[114274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36 Aug 26 00:25:14 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:14 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-60e9d406-4396-4f5d-8977-a144d9962f36" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-60e9d406-4396-4f5d-8977-a144d9962f36" released by "delete_volume" :: held 0.646s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Created reservations ['289f73c7-ca20-4407-9eed-50676b073058', 'a689060e-8a46-460f-a996-292a6f25f8ae', '722fe104-289a-4df4-9b55-912268877b33', '5d774c59-b2a8-4260-8d77-ceeb1dca2c1d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:14 devstack sudo[114277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:14 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:15 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Deleted volume successfully. Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1aa7692b-4ee8-402b-b661-1b98bdcd65e9 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-60e9d406-4396-4f5d-8977-a144d9962f36-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-20feabe5-3312-4dea-aa63-5906fe807ab2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-20feabe5-3312-4dea-aa63-5906fe807ab2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-quobyte-20feabe5-3312-4dea-aa63-5906fe807ab2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-20feabe5-3312-4dea-aa63-5906fe807ab2" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3c07a6-1b9d-4801-aacb-3c714ba6cc8a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:15 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 Aug 26 00:25:15 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:15 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2" returned: 0 in 0.352s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:15 devstack sudo[114285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2 Aug 26 00:25:15 devstack sudo[114285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:15 devstack sudo[114285]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-20feabe5-3312-4dea-aa63-5906fe807ab2" returned: 0 in 0.240s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-20feabe5-3312-4dea-aa63-5906fe807ab2" released by "delete_volume" :: held 0.641s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Created reservations ['f4be797c-043c-4e0d-b7a0-89245ea9fd6d', 'ab93b9b5-3a44-4087-ad38-77dacec29dfd', 'd4150a30-82f0-4bf6-81f2-f774831567d5', '77acc19a-d3ec-4409-b2c4-f26c68bf0d32'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:16 devstack sudo[114288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:16 devstack sudo[114288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:16 devstack sudo[114288]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.246s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Deleted volume successfully. Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-476b2e76-33f5-4309-a050-c39b1df61907 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-20feabe5-3312-4dea-aa63-5906fe807ab2-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-2e1f36d3-5d04-45e6-bc97-20f01c58c47f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-2e1f36d3-5d04-45e6-bc97-20f01c58c47f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "cinder-quobyte-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1c2d94-2be8-4fb1-be26-8c46d0e3af1a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:16 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f Aug 26 00:25:16 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:16 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:16 devstack sudo[114296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f Aug 26 00:25:16 devstack sudo[114296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:17 devstack sudo[114296]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" returned: 0 in 0.245s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-quobyte-2e1f36d3-5d04-45e6-bc97-20f01c58c47f" released by "delete_volume" :: held 0.640s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Created reservations ['bc601ade-c587-4116-bcec-8e3675d28d14', 'e5828339-4cd6-48fb-9063-b440ca4dcf5f', 'f274bae9-ca50-4439-b73d-768d6d7aea4c', '69327b18-3398-4468-9e52-442781411a31'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:17 devstack sudo[114299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:17 devstack sudo[114299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:17 devstack sudo[114299]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.245s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Deleted volume successfully. Aug 26 00:25:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f6362121-79ec-41bb-b8a5-c88d930d7105 tempest-CreateVolumesFromImageTest-863931824 None] Lock "cinder-2e1f36d3-5d04-45e6-bc97-20f01c58c47f-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=56,cinder:SELECT=41,cinder:INSERT=12,cinder:DELETE=6 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:25:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=29,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=13 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (41baf7c7-6ec5-45bb-aef2-ef407a8f51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27763980-15fa-4b49-b851-8f5e76d28d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27763980-15fa-4b49-b851-8f5e76d28d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88200704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df76dcd7-3d1e-45ce-ba50-843b1b3a0994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5d496b-b915-4f7f-821e-58a64164a776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5d496b-b915-4f7f-821e-58a64164a776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3133b0-bbba-4d72-a533-d297674f2299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3133b0-bbba-4d72-a533-d297674f2299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df76dcd7-3d1e-45ce-ba50-843b1b3a0994', 'volume_name': 'volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6ec4cc-dff8-4225-a611-56e09bcfef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6ec4cc-dff8-4225-a611-56e09bcfef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb747b9f-51fc-469d-9121-e59a415a82e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Volume df76dcd7-3d1e-45ce-ba50-843b1b3a0994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994', 'volume_size': 1} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-88200704',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df76dcd7-3d1e-45ce-ba50-843b1b3a0994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Creating volume df76dcd7-3d1e-45ce-ba50-843b1b3a0994 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:29 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:29 devstack sudo[114341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 1073741824 Aug 26 00:25:29 devstack sudo[114341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Flow 'volume_create_manager' (97d556be-9c39-47d5-b9a9-ec834b16697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f95622-9879-4463-b826-179a8def0fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (fe48d3dd-03f5-4d08-b57f-6ceaba61dfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a50fdb-655c-4be1-ad59-fa4bafd16978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f95622-9879-4463-b826-179a8def0fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1412035359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90849a8-f033-4a59-bf37-1b54d225155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493c4474860845e3b5386105d99e6254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='fe86304f629d4a8e9f2ef21c870b46ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02acc1-f8c7-451c-984c-a470ca4167a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c02acc1-f8c7-451c-984c-a470ca4167a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323145f4-6941-49f1-88bf-22840cb917ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (323145f4-6941-49f1-88bf-22840cb917ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90849a8-f033-4a59-bf37-1b54d225155c', 'volume_name': 'volume-d90849a8-f033-4a59-bf37-1b54d225155c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f35882-097e-492c-b863-735f45803ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08f35882-097e-492c-b863-735f45803ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f948ca-3ab4-4305-a605-0d364fcb093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Volume d90849a8-f033-4a59-bf37-1b54d225155c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90849a8-f033-4a59-bf37-1b54d225155c', 'volume_size': 1} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a50fdb-655c-4be1-ad59-fa4bafd16978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349983977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82da2b82-8c21-4196-9497-416610b7567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c44212-10be-4c81-81b5-a022e7c41208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c44212-10be-4c81-81b5-a022e7c41208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82a5205-7c9b-4bae-ad41-3504ed1ae971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82a5205-7c9b-4bae-ad41-3504ed1ae971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82da2b82-8c21-4196-9497-416610b7567f', 'volume_name': 'volume-82da2b82-8c21-4196-9497-416610b7567f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0f533-7485-4e8b-b783-fa081cf9fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a0f533-7485-4e8b-b783-fa081cf9fd12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d1ef5-ecc6-4c52-b535-e2a41db3e7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Volume 82da2b82-8c21-4196-9497-416610b7567f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82da2b82-8c21-4196-9497-416610b7567f', 'volume_size': 1} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (cb1289e3-5e65-43b8-836c-3c74d2d87dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4156a485-f253-4449-a551-9d77ca6ac4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4156a485-f253-4449-a551-9d77ca6ac4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645089099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7ce9fd-87fa-4449-af49-b0a412ae394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:30Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a0cea1-5d1a-4bda-922a-389fb0fc108a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4a0cea1-5d1a-4bda-922a-389fb0fc108a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack sudo[114341]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67011d21-88db-419d-81e0-e9f9a4465e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67011d21-88db-419d-81e0-e9f9a4465e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7ce9fd-87fa-4449-af49-b0a412ae394d', 'volume_name': 'volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed82a5a-7972-4396-857d-b0aab8a74e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ed82a5a-7972-4396-857d-b0aab8a74e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc491af-3223-4a28-9175-6e379fc454dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Volume ce7ce9fd-87fa-4449-af49-b0a412ae394d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d', 'volume_size': 1} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 1073741824" returned: 0 in 0.683s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:30 devstack sudo[114347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 Aug 26 00:25:30 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:30 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" returned: 0 in 0.385s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1412035359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90849a8-f033-4a59-bf37-1b54d225155c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493c4474860845e3b5386105d99e6254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='fe86304f629d4a8e9f2ef21c870b46ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Creating volume d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:30 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb747b9f-51fc-469d-9121-e59a415a82e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack sudo[114351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c 1073741824 Aug 26 00:25:30 devstack sudo[114351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db2dd1e-017d-4b56-b17e-0208e05d8c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (4a987df4-0817-453f-9f21-021f388258b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d33b3e-3cf0-4807-9431-505bceaa6079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Volume volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 (df76dcd7-3d1e-45ce-ba50-843b1b3a0994): created successfully Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db2dd1e-017d-4b56-b17e-0208e05d8c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (41baf7c7-6ec5-45bb-aef2-ef407a8f51e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5d33b3e-3cf0-4807-9431-505bceaa6079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183424816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1af2a4-d117-4fb3-9886-2b605bb65462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:30Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4151fa-1cf4-4151-b6cf-a53f41381d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4151fa-1cf4-4151-b6cf-a53f41381d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c05e51-ca82-452d-9794-cbffdf62de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c05e51-ca82-452d-9794-cbffdf62de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1af2a4-d117-4fb3-9886-2b605bb65462', 'volume_name': 'volume-7b1af2a4-d117-4fb3-9886-2b605bb65462', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8e7c2e-694c-46f9-bca8-b329b23b6091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d8e7c2e-694c-46f9-bca8-b329b23b6091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c631b8-0e5f-47ce-a0e0-559e9f11065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Volume 7b1af2a4-d117-4fb3-9886-2b605bb65462: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1af2a4-d117-4fb3-9886-2b605bb65462', 'volume_size': 1} Aug 26 00:25:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:30 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-123d4e77-6dcf-47b3-8c1b-225ccd37f2fd tempest-CreateVolumesFromImageTest-978036464 None] Created volume successfully. Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (33869dc0-edf2-465e-bed7-9c6249cb4f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d797551-da32-41e1-8fe3-988dc54fa187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d797551-da32-41e1-8fe3-988dc54fa187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027613985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58930d75-eb9e-4da4-9a0a-f8ac6bef060f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:31Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d05bc51-7243-47d2-98fa-201766dd6b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack sudo[114351]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d05bc51-7243-47d2-98fa-201766dd6b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f33317-d167-4a03-8611-11ae01843f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f33317-d167-4a03-8611-11ae01843f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58930d75-eb9e-4da4-9a0a-f8ac6bef060f', 'volume_name': 'volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a270b5e7-ad48-4b8a-a8dc-c1ef595150db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a270b5e7-ad48-4b8a-a8dc-c1ef595150db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e65f3-5df6-4260-b0bb-be110e4f23ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Volume 58930d75-eb9e-4da4-9a0a-f8ac6bef060f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f', 'volume_size': 1} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c 1073741824" returned: 0 in 0.686s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:31 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:31 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:31 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1349983977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82da2b82-8c21-4196-9497-416610b7567f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:29Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Creating volume 82da2b82-8c21-4196-9497-416610b7567f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:31 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f948ca-3ab4-4305-a605-0d364fcb093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90849a8-f033-4a59-bf37-1b54d225155c', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d0ded0-c133-4a25-a697-4610f5a3167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:31 devstack sudo[114361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f 1073741824 Aug 26 00:25:31 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:31 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Volume volume-d90849a8-f033-4a59-bf37-1b54d225155c (d90849a8-f033-4a59-bf37-1b54d225155c): created successfully Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d0ded0-c133-4a25-a697-4610f5a3167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Flow 'volume_create_manager' (97d556be-9c39-47d5-b9a9-ec834b16697b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9cc1ac15-de45-4a67-9a2e-353340f23a7e tempest-VolumeDependencyTests-750789730 None] Created volume successfully. Aug 26 00:25:32 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f 1073741824" returned: 0 in 0.507s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:32 devstack sudo[114367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f Aug 26 00:25:32 devstack sudo[114367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:32 devstack sudo[114367]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f" returned: 0 in 0.333s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.376s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1645089099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7ce9fd-87fa-4449-af49-b0a412ae394d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:30Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Creating volume ce7ce9fd-87fa-4449-af49-b0a412ae394d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:32 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59d1ef5-ecc6-4c52-b535-e2a41db3e7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82da2b82-8c21-4196-9497-416610b7567f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1a4c5e-78f8-4a02-b692-dcfa28b0c163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:32 devstack sudo[114370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d 1073741824 Aug 26 00:25:32 devstack sudo[114370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Volume volume-82da2b82-8c21-4196-9497-416610b7567f (82da2b82-8c21-4196-9497-416610b7567f): created successfully Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f1a4c5e-78f8-4a02-b692-dcfa28b0c163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (fe48d3dd-03f5-4d08-b57f-6ceaba61dfab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d0a257b7-bc5f-4b0d-a7c8-73f0a4a04a79 tempest-CreateVolumesFromImageTest-978036464 None] Created volume successfully. Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Flow 'volume_create_manager' (d19cdf9d-c8c9-4c29-ae06-adea9e788d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd38e662-fd14-452d-97d1-d2502c06b439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd38e662-fd14-452d-97d1-d2502c06b439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be3a396-7f73-4b83-8e65-51630723b9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7853ecab88fc4edf9f182da80941d4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:33Z,use_quota=True,user_id='87314794d73a4d51acb6754bc6275f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd6930d-fcac-4aa9-bea4-923a2f332227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd6930d-fcac-4aa9-bea4-923a2f332227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb3492-3c75-4857-8675-253f219dc2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:25:32 devstack sudo[114370]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d 1073741824" returned: 0 in 0.517s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:33 devstack sudo[114376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d Aug 26 00:25:33 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5cb3492-3c75-4857-8675-253f219dc2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3be3a396-7f73-4b83-8e65-51630723b9fb', 'volume_name': 'volume-3be3a396-7f73-4b83-8e65-51630723b9fb', 'volume_size': 1, 'image_id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'deaa14bf7b7dbdbfd4752bb671110c91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7853ecab88fc4edf9f182da80941d4b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c05ddca03e3156673e3bc3a4519d4ef53869ab3ff593c49f3d68520f120c8234127281f5e37229f15c45b9fee5216368ea8cd53a0d6ffd0a760a25ab5efe6b5', 'id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178f264-8bf5-4e83-bc63-cfe53366b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c178f264-8bf5-4e83-bc63-cfe53366b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c75f67-b3e3-4345-bbbd-bead10b98098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Volume 3be3a396-7f73-4b83-8e65-51630723b9fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3be3a396-7f73-4b83-8e65-51630723b9fb', 'volume_size': 1, 'image_id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'deaa14bf7b7dbdbfd4752bb671110c91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7853ecab88fc4edf9f182da80941d4b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c05ddca03e3156673e3bc3a4519d4ef53869ab3ff593c49f3d68520f120c8234127281f5e37229f15c45b9fee5216368ea8cd53a0d6ffd0a760a25ab5efe6b5', 'id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5/file', 'properties': {}}, 'image_service': } Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Trying to clone 3be3a396-7f73-4b83-8e65-51630723b9fb from image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Image download 0.00 MB at 0.00 MB/s Aug 26 00:25:33 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d" returned: 0 in 0.287s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.573s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1183424816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1af2a4-d117-4fb3-9886-2b605bb65462,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:30Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Creating volume 7b1af2a4-d117-4fb3-9886-2b605bb65462 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc491af-3223-4a28-9175-6e379fc454dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 1073741824 Aug 26 00:25:33 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e75be5-d621-45fa-bcd2-311a6cbf00c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5bc327-c60e-48a1-a0c4-a0e01d112887]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Volume volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d (ce7ce9fd-87fa-4449-af49-b0a412ae394d): created successfully Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e75be5-d621-45fa-bcd2-311a6cbf00c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (cb1289e3-5e65-43b8-836c-3c74d2d87dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2aab5863-d7e7-4f06-aaee-66d44cc9411d tempest-CreateVolumesFromImageTest-978036464 None] Created volume successfully. Aug 26 00:25:33 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:33 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Flow 'volume_create_manager' (40c2424f-b394-4ff3-b34c-3f00c08e793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e26c528-315c-4ed5-8138-80005db1e2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e26c528-315c-4ed5-8138-80005db1e2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aff982-e256-4f8e-9c1a-39850a676aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77026eaf346543c3b5fc7b1d5401c2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:34Z,use_quota=True,user_id='b9676dfe48764db6b2e3541173865dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13417dd1-c097-49fd-b33d-3594557fb2f5),volume_type_id=13417dd1-c097-49fd-b33d-3594557fb2f5)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404cdd11-a9cf-4fa0-aac1-a900791267f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (404cdd11-a9cf-4fa0-aac1-a900791267f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9c4af2-3e0f-4e4e-ac9a-61b574642fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.image.glance [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Creating Keystone auth plugin from conf {{(pid=94433) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 00:25:33 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:33 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 1073741824" returned: 0 in 0.515s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:33 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 Aug 26 00:25:33 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:33 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:33 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b9c4af2-3e0f-4e4e-ac9a-61b574642fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17aff982-e256-4f8e-9c1a-39850a676aab', 'volume_name': 'volume-17aff982-e256-4f8e-9c1a-39850a676aab', 'volume_size': 1, 'image_id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65e5bea06a98f0626290997de857553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77026eaf346543c3b5fc7b1d5401c2c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4bddf4dd3c53bd3094fd76864d7dc8282e3f2da7c0d9931ecefd2adec12001869764e8948e5be1591af14bd826987755d29962465d38f25768428825e7a3a6a', 'id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6732174a-1176-4e7d-b5e1-98d5a4c96992/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25271829-c584-45aa-a1d7-dd92343b0dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25271829-c584-45aa-a1d7-dd92343b0dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36cd235-7c9d-45fa-865d-e834053a4663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Volume 17aff982-e256-4f8e-9c1a-39850a676aab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17aff982-e256-4f8e-9c1a-39850a676aab', 'volume_size': 1, 'image_id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65e5bea06a98f0626290997de857553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77026eaf346543c3b5fc7b1d5401c2c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4bddf4dd3c53bd3094fd76864d7dc8282e3f2da7c0d9931ecefd2adec12001869764e8948e5be1591af14bd826987755d29962465d38f25768428825e7a3a6a', 'id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6732174a-1176-4e7d-b5e1-98d5a4c96992/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 00:25:33 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Trying to clone 17aff982-e256-4f8e-9c1a-39850a676aab from image 6732174a-1176-4e7d-b5e1-98d5a4c96992 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}]). {{(pid=94433) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 00:25:34 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Image download 0.00 MB at 0.00 MB/s Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b81a10-89ee-4cae-b81f-f91e827d8454]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.932s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2027613985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58930d75-eb9e-4da4-9a0a-f8ac6bef060f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb7cb9404f04a06b8b15553c55b47e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:31Z,use_quota=True,user_id='75520ad3f8e74002b5f8774806378608',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Creating volume 58930d75-eb9e-4da4-9a0a-f8ac6bef060f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:34 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:34 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Temporary image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 is fetched for user 87314794d73a4d51acb6754bc6275f60. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c631b8-0e5f-47ce-a0e0-559e9f11065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1af2a4-d117-4fb3-9886-2b605bb65462', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:34 devstack sudo[114401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f 1073741824 Aug 26 00:25:34 devstack sudo[114401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad15d06b-49d2-4a41-814d-b7b4b7f8a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Volume volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 (7b1af2a4-d117-4fb3-9886-2b605bb65462): created successfully Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad15d06b-49d2-4a41-814d-b7b4b7f8a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (4a987df4-0817-453f-9f21-021f388258b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-55608117-0782-498b-ace1-11598c3146bd tempest-CreateVolumesFromImageTest-978036464 None] Created volume successfully. Aug 26 00:25:34 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:34 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fc88d5-785c-407e-81a3-bed36adb4d76]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:34 devstack sudo[114404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:34 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack sudo[114404]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114401]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f 1073741824" returned: 0 in 0.522s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f Aug 26 00:25:34 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:34 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:34 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Temporary image 6732174a-1176-4e7d-b5e1-98d5a4c96992 is fetched for user b9676dfe48764db6b2e3541173865dc2. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b046f-b6b8-472d-9fca-1fa15d2fdfcf]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:34 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" returned: 0 in 0.267s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.334s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Creating offline snapshot 6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b of volume d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (279e65f3-5df6-4260-b0bb-be110e4f23ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cf1328-c951-4054-9c4a-c88dfadf7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7669c9f5-0723-445b-92e8-b9270b6a8af6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:35 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 1 in 0.416s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Volume volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f (58930d75-eb9e-4da4-9a0a-f8ac6bef060f): created successfully Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cf1328-c951-4054-9c4a-c88dfadf7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Flow 'volume_create_manager' (33869dc0-edf2-465e-bed7-9c6249cb4f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:35 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:35 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-45b8474d-80dd-42d2-8d90-218b6bb5c965 tempest-CreateVolumesFromImageTest-978036464 None] Created volume successfully. Aug 26 00:25:35 devstack sudo[114515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:35 devstack sudo[114515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:35 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:35 devstack sudo[114515]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.397s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:35 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:35 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:35 devstack sudo[114525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b 1G Aug 26 00:25:35 devstack sudo[114525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-58930d75-eb9e-4da4-9a0a-f8ac6bef060f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-58930d75-eb9e-4da4-9a0a-f8ac6bef060f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-quobyte-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60bc349-2329-4e15-8235-e0cfdfa8b415]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:35 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 1 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:35 devstack sudo[114532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f Aug 26 00:25:35 devstack sudo[114532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:35 devstack sudo[114525]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b 1G" returned: 0 in 0.455s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90849a8-f033-4a59-bf37-1b54d225155c -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:35 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90849a8-f033-4a59-bf37-1b54d225155c -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:35 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack sudo[114532]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:36 devstack sudo[114542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f Aug 26 00:25:36 devstack sudo[114542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d90849a8-f033-4a59-bf37-1b54d225155c -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.299s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b is being set with open permissions: ugo+rw Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:36 devstack sudo[114547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:36 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack sudo[114542]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-58930d75-eb9e-4da4-9a0a-f8ac6bef060f" released by "delete_volume" :: held 0.743s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Created reservations ['410d5967-7dc1-4f58-ad08-edbab90eba93', 'd0e20681-e899-4e86-bd55-d891452cc11a', 'e3711fca-3f04-4809-bb22-b98f0886c6d1', '1e539bf7-cfad-497b-affc-41092b381743'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:36 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:36 devstack sudo[114551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info Aug 26 00:25:36 devstack sudo[114551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:36 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-7b1af2a4-d117-4fb3-9886-2b605bb65462-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-7b1af2a4-d117-4fb3-9886-2b605bb65462-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:36 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Deleted volume successfully. Aug 26 00:25:36 devstack sudo[114551]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info" returned: 0 in 0.323s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:36 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info is being set with open permissions: ugo+rw Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:36 devstack sudo[114557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-quobyte-7b1af2a4-d117-4fb3-9886-2b605bb65462" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:36 devstack sudo[114557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-809b0ff0-0252-41ff-aea9-c754e5a3b7a3 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-58930d75-eb9e-4da4-9a0a-f8ac6bef060f-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-7b1af2a4-d117-4fb3-9886-2b605bb65462" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9d8c0-1c85-463d-89a5-3514675066cd]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 Aug 26 00:25:37 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack sudo[114557]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.info" returned: 0 in 0.278s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.046s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be3a396-7f73-4b83-8e65-51630723b9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7853ecab88fc4edf9f182da80941d4b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:33Z,use_quota=True,user_id='87314794d73a4d51acb6754bc6275f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Creating volume 3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1073741824 Aug 26 00:25:37 devstack sudo[114562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b40aea7d-2989-491f-a1eb-e1092e35b687 tempest-VolumeDependencyTests-750789730 None] Create snapshot completed successfully Aug 26 00:25:37 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462" returned: 0 in 0.388s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462 Aug 26 00:25:37 devstack sudo[114567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack sudo[114562]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1073741824" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack sudo[114567]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7b1af2a4-d117-4fb3-9886-2b605bb65462" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-7b1af2a4-d117-4fb3-9886-2b605bb65462" released by "delete_volume" :: held 0.703s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb Aug 26 00:25:37 devstack sudo[114573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Created reservations ['19f00cc0-9914-44f3-bbb6-10d7f75e3d5f', 'd8170dcb-743f-4811-abd5-2495ef22a750', '7fa650e2-6736-463d-bd42-bd3d7d7dd576', 'da3d0557-44c4-41cd-89b5-7e16415eda88'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:37 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack sudo[114573]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17aff982-e256-4f8e-9c1a-39850a676aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77026eaf346543c3b5fc7b1d5401c2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:34Z,use_quota=True,user_id='b9676dfe48764db6b2e3541173865dc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13417dd1-c097-49fd-b33d-3594557fb2f5),volume_type_id=13417dd1-c097-49fd-b33d-3594557fb2f5)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Creating volume 17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:37 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:37 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1073741824 Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Attempting download of 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}])) to volume 3be3a396-7f73-4b83-8e65-51630723b9fb. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:25:37 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:37 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:37 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Deleted volume successfully. Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-ce7ce9fd-87fa-4449-af49-b0a412ae394d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-609a63ea-490d-48ba-a5c2-0738703afc44 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-7b1af2a4-d117-4fb3-9886-2b605bb65462-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[35afb9ee-7e15-4930-9f41-0686fa47148b]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-ce7ce9fd-87fa-4449-af49-b0a412ae394d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-quobyte-ce7ce9fd-87fa-4449-af49-b0a412ae394d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-ce7ce9fd-87fa-4449-af49-b0a412ae394d" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc5192b-eef1-485d-863c-f19160ca1b41]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji Aug 26 00:25:38 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack sudo[114583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d Aug 26 00:25:38 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:38 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Flow 'volume_create_manager' (89a34c06-f26c-45e9-9a70-15f3da7a431d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda929a7-754f-4bc2-bd2b-56cb29835420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:38 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda929a7-754f-4bc2-bd2b-56cb29835420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1479576436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='493c4474860845e3b5386105d99e6254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:38Z,use_quota=True,user_id='fe86304f629d4a8e9f2ef21c870b46ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e85a80-fb6d-46aa-8b2a-9fc07908442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e85a80-fb6d-46aa-8b2a-9fc07908442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b70f605-cae3-402a-a92f-ccc0b8a8f55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b70f605-cae3-402a-a92f-ccc0b8a8f55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09', 'volume_name': 'volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09', 'volume_size': 1, 'snapshot_id': '6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1341bc-0b9a-4c9f-8252-c25052819de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1341bc-0b9a-4c9f-8252-c25052819de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d0ed6-7591-4a3a-a947-8c4e52e16051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Volume 7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09', 'volume_size': 1, 'snapshot_id': '6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b'} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1073741824" returned: 0 in 0.695s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:38 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:38 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab Aug 26 00:25:38 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d" returned: 0 in 0.508s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack sudo[114599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d Aug 26 00:25:38 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji" returned: 1 in 0.355s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_rhr_mjji' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1179ad92-5639-448b-9484-536babaf81ed]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:38 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.296s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Creating volume 7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 from snapshot 6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Attempting download of 6732174a-1176-4e7d-b5e1-98d5a4c96992 ((None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}])) to volume 17aff982-e256-4f8e-9c1a-39850a676aab. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] snapshot: 6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b, volume: 7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:25:38 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:38 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:38 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ce7ce9fd-87fa-4449-af49-b0a412ae394d" returned: 0 in 0.290s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-ce7ce9fd-87fa-4449-af49-b0a412ae394d" released by "delete_volume" :: held 0.885s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebf72e5-d48b-4fdd-a483-24887e24b701]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[62175fbf-1743-4b30-a6d3-9c52bfb12dc7]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Created reservations ['df37ed3a-5f98-4c92-a266-9d4fc9753892', 'ec1d2cef-d669-43f8-ac6f-fe97649fbdaf', '30cde7be-648a-4128-8af9-d5879b8bf8b7', '5b547ba8-c276-41fb-bcff-d83fc478e3c2'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:39 devstack sudo[114607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:39 devstack sudo[114607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:39 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9 Aug 26 00:25:39 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:39 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD Aug 26 00:25:39 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114607]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d90849a8-f033-4a59-bf37-1b54d225155c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:25:39 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc2eb3f-0bf5-48ee-9d9c-ad255a3c2e5f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9" returned: 0 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Deleted volume successfully. Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-9dcef851-b057-434c-8072-cadfc016efdd tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-ce7ce9fd-87fa-4449-af49-b0a412ae394d-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:39 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:39 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD" returned: 1 in 0.384s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 was raw, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9 Aug 26 00:25:39 devstack sudo[114624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb Aug 26 00:25:39 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114624]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9" returned: 1 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6732174a-1176-4e7d-b5e1-98d5a4c96992_9qk55tm9' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be4e9f8-5285-4871-8e55-04001556f92b]: (4, 'raw') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:25:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:39 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 Aug 26 00:25:39 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:39 devstack sudo[114639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:39 devstack sudo[114639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:40 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb" returned: 0 in 0.525s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6af3747b-802f-4bb0-9abe-9f2311dd6ae5_2ukqj6mldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:25:40 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:40 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1G Aug 26 00:25:40 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:40 devstack sudo[114639]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-82da2b82-8c21-4196-9497-416610b7567f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-82da2b82-8c21-4196-9497-416610b7567f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:40 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD Aug 26 00:25:40 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-quobyte-82da2b82-8c21-4196-9497-416610b7567f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-82da2b82-8c21-4196-9497-416610b7567f" acquired by "delete_volume" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cb1a57-894e-4270-9b89-1c1ebec9bece]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:40 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD" returned: 1 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD' failed. Not Retrying. {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] 6732174a-1176-4e7d-b5e1-98d5a4c96992 was raw, converting to qcow2 {{(pid=94433) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:40 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab Aug 26 00:25:40 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:40 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb 1G" returned: 0 in 0.620s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Downloaded image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 ((None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}])) to volume 3be3a396-7f73-4b83-8e65-51630723b9fb successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Temporary image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 for user 87314794d73a4d51acb6754bc6275f60 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Marking volume 3be3a396-7f73-4b83-8e65-51630723b9fb as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Copying metadata from image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 to 3be3a396-7f73-4b83-8e65-51630723b9fb. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:25:40 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Creating volume glance metadata for volume 3be3a396-7f73-4b83-8e65-51630723b9fb backed by image 6af3747b-802f-4bb0-9abe-9f2311dd6ae5 with: {'image_id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'deaa14bf7b7dbdbfd4752bb671110c91', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:25:40 devstack sudo[114668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f Aug 26 00:25:40 devstack sudo[114668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c75f67-b3e3-4345-bbbd-bead10b98098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be3a396-7f73-4b83-8e65-51630723b9fb', 'volume_size': 1, 'image_id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'deaa14bf7b7dbdbfd4752bb671110c91', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '7853ecab88fc4edf9f182da80941d4b8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8c05ddca03e3156673e3bc3a4519d4ef53869ab3ff593c49f3d68520f120c8234127281f5e37229f15c45b9fee5216368ea8cd53a0d6ffd0a760a25ab5efe6b5', 'id': '6af3747b-802f-4bb0-9abe-9f2311dd6ae5', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6af3747b-802f-4bb0-9abe-9f2311dd6ae5/file', 'properties': {}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33be7bcf-1ce6-4f78-8fe1-f2a80da9d466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:41 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Volume volume-3be3a396-7f73-4b83-8e65-51630723b9fb (3be3a396-7f73-4b83-8e65-51630723b9fb): created successfully Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33be7bcf-1ce6-4f78-8fe1-f2a80da9d466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Flow 'volume_create_manager' (d19cdf9d-c8c9-4c29-ae06-adea9e788d06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-24ec657d-7dd5-492c-914b-d8ef2a21c1aa tempest-VolumeImageDependencyTests-1941513375 None] Created volume successfully. Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Acquiring lock "cinder-3be3a396-7f73-4b83-8e65-51630723b9fb-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "cinder-3be3a396-7f73-4b83-8e65-51630723b9fb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:41 devstack sudo[114668]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f" returned: 0 in 1.174s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Acquiring lock "cinder-quobyte-3be3a396-7f73-4b83-8e65-51630723b9fb" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:41 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f Aug 26 00:25:41 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "cinder-quobyte-3be3a396-7f73-4b83-8e65-51630723b9fb" acquired by "delete_volume" :: waited 0.054s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c42bf3b-bc98-42e7-a679-8292b3f80f25]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:42 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab" returned: 0 in 1.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6732174a-1176-4e7d-b5e1-98d5a4c96992_xyw50x18devstack@QuobyteHD, size 0.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:25:42 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:42 devstack sudo[114683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1G Aug 26 00:25:42 devstack sudo[114683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:42 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb Aug 26 00:25:42 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:42 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-82da2b82-8c21-4196-9497-416610b7567f" returned: 0 in 0.696s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-82da2b82-8c21-4196-9497-416610b7567f" released by "delete_volume" :: held 1.978s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Created reservations ['aebf0325-0554-41fc-a61f-8f051ad52313', '7bc07fa4-cb70-4874-a3c8-8ce69a859686', '9e48e0f2-fc30-4be5-a0f5-b3d6a66afb6e', '3de3c21b-4a07-4b92-80cd-f6d6a66f9672'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:42 devstack sudo[114683]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab 1G" returned: 0 in 0.838s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Downloaded image 6732174a-1176-4e7d-b5e1-98d5a4c96992 ((None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}])) to volume 17aff982-e256-4f8e-9c1a-39850a676aab successfully. {{(pid=94433) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Temporary image 6732174a-1176-4e7d-b5e1-98d5a4c96992 for user b9676dfe48764db6b2e3541173865dc2 is deleted. {{(pid=94433) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.volume_utils [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Marking volume 17aff982-e256-4f8e-9c1a-39850a676aab as bootable. {{(pid=94433) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Copying metadata from image 6732174a-1176-4e7d-b5e1-98d5a4c96992 to 17aff982-e256-4f8e-9c1a-39850a676aab. {{(pid=94433) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 00:25:42 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Creating volume glance metadata for volume 17aff982-e256-4f8e-9c1a-39850a676aab backed by image 6732174a-1176-4e7d-b5e1-98d5a4c96992 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f65e5bea06a98f0626290997de857553', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94433) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 00:25:42 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:42 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-df76dcd7-3d1e-45ce-ba50-843b1b3a0994-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-df76dcd7-3d1e-45ce-ba50-843b1b3a0994-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d36cd235-7c9d-45fa-865d-e834053a4663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aff982-e256-4f8e-9c1a-39850a676aab', 'volume_size': 1, 'image_id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6732174a-1176-4e7d-b5e1-98d5a4c96992', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f65e5bea06a98f0626290997de857553', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '77026eaf346543c3b5fc7b1d5401c2c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b4bddf4dd3c53bd3094fd76864d7dc8282e3f2da7c0d9931ecefd2adec12001869764e8948e5be1591af14bd826987755d29962465d38f25768428825e7a3a6a', 'id': '6732174a-1176-4e7d-b5e1-98d5a4c96992', 'created_at': datetime.datetime(2026, 8, 25, 22, 25, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 25, 22, 25, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6732174a-1176-4e7d-b5e1-98d5a4c96992/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e45b8ca-b3e4-41fc-b30f-5ae1594eef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "cinder-quobyte-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:43 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Volume volume-17aff982-e256-4f8e-9c1a-39850a676aab (17aff982-e256-4f8e-9c1a-39850a676aab): created successfully Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e45b8ca-b3e4-41fc-b30f-5ae1594eef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:43 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Flow 'volume_create_manager' (40c2424f-b394-4ff3-b34c-3f00c08e793c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb" returned: 0 in 1.414s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" acquired by "delete_volume" :: waited 0.131s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:43 devstack sudo[114696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb Aug 26 00:25:43 devstack sudo[114696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4668f956-0925-44f0-9866-3aaf674fc2f5 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Created volume successfully. Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e42890-5588-4bb7-88b8-bdf6c6fea875]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:43 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.767s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:43 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Deleted volume successfully. Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-055554e2-b6e6-4467-a718-22d2a6130562 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-82da2b82-8c21-4196-9497-416610b7567f-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:43 devstack sudo[114696]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Acquiring lock "cinder-17aff982-e256-4f8e-9c1a-39850a676aab-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-3be3a396-7f73-4b83-8e65-51630723b9fb" returned: 0 in 0.526s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:43 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 Aug 26 00:25:43 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "cinder-17aff982-e256-4f8e-9c1a-39850a676aab-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "cinder-quobyte-3be3a396-7f73-4b83-8e65-51630723b9fb" released by "delete_volume" :: held 2.103s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Acquiring lock "cinder-quobyte-17aff982-e256-4f8e-9c1a-39850a676aab" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "cinder-quobyte-17aff982-e256-4f8e-9c1a-39850a676aab" acquired by "delete_volume" :: waited 0.058s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Created reservations ['43dcf0f6-f465-4077-aaf7-6cd4922cc26a', '886d4723-0bee-4fc7-8f88-caba22348590', '1184791b-2f09-4b23-80a1-4a28d8fbcb37', 'ab126a09-efc4-4947-9e6b-eed9cf5a896f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dc519e-b5cd-444b-86b8-968cab3bf44d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:44 devstack sudo[114704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab Aug 26 00:25:44 devstack sudo[114704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:44 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" returned: 0 in 1.076s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:44 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:44 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:44 devstack sudo[114708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994 Aug 26 00:25:44 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:44 devstack sudo[114704]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab" returned: 0 in 0.677s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:45 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab Aug 26 00:25:45 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:45 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.556s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Deleted volume successfully. Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-52d1752f-763a-4212-9ae1-a85116c9880e tempest-VolumeImageDependencyTests-1941513375 None] Lock "cinder-3be3a396-7f73-4b83-8e65-51630723b9fb-delete_volume" released by "delete_volume" :: held 3.495s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:45 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" returned: 0 in 0.748s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-quobyte-df76dcd7-3d1e-45ce-ba50-843b1b3a0994" released by "delete_volume" :: held 1.955s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Created reservations ['5ccef341-3e0e-44c0-a7d7-b7a72e7f3206', 'a22156a2-b404-484c-a494-ca64f1edbcf1', '82a25049-7eb3-4e4e-8139-47a4154acef6', '8144bdb2-38c7-431b-bb92-6b8e0ffaae29'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:45 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-17aff982-e256-4f8e-9c1a-39850a676aab" returned: 0 in 0.793s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "cinder-quobyte-17aff982-e256-4f8e-9c1a-39850a676aab" released by "delete_volume" :: held 1.646s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:46 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:46 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Created reservations ['70fdc406-1a2d-490c-9c5f-19c2497e78bd', '8f02b001-46dd-4a6d-b53c-ae6ba114dc12', 'ea405fc7-7421-479a-b291-5f0033306fe1', '32ca7d1d-2509-4d1f-947c-b8b1a3e7a2a1'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:46 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:46 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:46 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" returned: 0 in 6.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:25:46 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Converted 1024.00 MB image at 161.26 MB/s Aug 26 00:25:46 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 is being set with open permissions: ugo+rw Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:46 devstack sudo[114723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 Aug 26 00:25:46 devstack sudo[114723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:46 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.526s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Deleted volume successfully. Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be7422ec-507d-4d76-9d44-6234278e1b95 tempest-CreateVolumesFromImageTest-978036464 None] Lock "cinder-df76dcd7-3d1e-45ce-ba50-843b1b3a0994-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:46 devstack sudo[114723]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" released by "_copy_volume_from_snapshot" :: held 7.568s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:46 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Deleted volume successfully. Aug 26 00:25:46 devstack sudo[114728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" released by "_create_volume_from_snapshot" :: held 7.691s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:46 devstack sudo[114728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.720s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d4d31966-6143-4da2-bddb-95abddbf1e34 tempest-VolumeAndVolumeTypeFromImageTest-1385817989 None] Lock "cinder-17aff982-e256-4f8e-9c1a-39850a676aab-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (098d0ed6-7591-4a3a-a947-8c4e52e16051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09', 'volume_size': 1, 'snapshot_id': '6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8bdbe-aaf9-4b86-b4d4-650d7665f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:46 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Volume volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 (7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09): created successfully Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d8bdbe-aaf9-4b86-b4d4-650d7665f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Flow 'volume_create_manager' (89a34c06-f26c-45e9-9a70-15f3da7a431d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-eb9d34b0-038f-4264-9989-6f6c541a4c10 tempest-VolumeDependencyTests-750789730 None] Created volume successfully. Aug 26 00:25:46 devstack sudo[114728]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.332s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:25:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Deleting offline snapshot 6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b of volume d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] snapshot_file for this snap is: volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b53eb5-9622-4b72-8fe7-904e41123685]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:47 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:47 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:48 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.477s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d90849a8-f033-4a59-bf37-1b54d225155c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4088ad0e-523c-47ee-8be5-a519230c9cf7]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:48 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:48 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:48 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.718s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:48 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:48 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:49 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.429s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:49 devstack sudo[114749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b Aug 26 00:25:49 devstack sudo[114749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:49 devstack sudo[114749]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c.6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b" released by "_delete_snapshot" :: held 2.140s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" released by "delete_snapshot" :: held 2.183s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Created reservations ['4c6422ca-bdd0-4afc-8653-1a5185a45715', 'cb48b2f4-0e18-4dc1-8456-7a701634267c', '6cad154a-7e09-48ed-8716-033b3951e64d', '4af824b8-123c-4949-b5cb-ce98e7415697'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Delete snapshot completed successfully. Aug 26 00:25:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00da046f-2da6-4dbf-b839-63372ea17206 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-6d6bb8c6-ab2b-49b7-ab0e-20c4b753af5b-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-d90849a8-f033-4a59-bf37-1b54d225155c-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-d90849a8-f033-4a59-bf37-1b54d225155c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbc94f6-60b3-403f-b483-86f6d6ff413a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:51 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:51 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:51 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.444s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7572db2e-49fb-4e11-ac06-f63390d040a8 tempest-ProjectAdminTests-89055408 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.904396057129, 'free_capacity_gb': 1774.904396057129, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94433) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 00:25:51 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c Aug 26 00:25:51 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:51 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d90849a8-f033-4a59-bf37-1b54d225155c" returned: 0 in 0.278s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-d90849a8-f033-4a59-bf37-1b54d225155c" released by "delete_volume" :: held 0.805s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Created reservations ['3ec25ba9-79d6-45bf-a528-49137ec53efa', 'c26c116d-b9a3-44a9-ab73-85f668b2d6e1', '8fcbe9a6-2dba-402c-a469-bc7a0d278462', '903c2559-0ccf-4dd6-a328-901629d75bf4'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:51 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:51 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:25:52 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6822e1d5-0342-44f5-b05f-9027ad492bef]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Deleted volume successfully. Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (a8c3fc7a-add6-4e5b-b416-2379f4f353f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d608e7d7-b171-42ad-bcfd-4ab717a1e205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d608e7d7-b171-42ad-bcfd-4ab717a1e205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182042294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f86b176-2564-4709-983c-20d31a3f56d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:52Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712e3383-6f90-44a4-9028-7473ed5006f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712e3383-6f90-44a4-9028-7473ed5006f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184d158b-a4ab-4d6f-979a-5b476d968076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184d158b-a4ab-4d6f-979a-5b476d968076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f86b176-2564-4709-983c-20d31a3f56d3', 'volume_name': 'volume-9f86b176-2564-4709-983c-20d31a3f56d3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c540388-3dbb-403f-8a0e-5b4705b2ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c540388-3dbb-403f-8a0e-5b4705b2ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b004d48-2841-45de-8002-7023e3d13f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume 9f86b176-2564-4709-983c-20d31a3f56d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f86b176-2564-4709-983c-20d31a3f56d3', 'volume_size': 1} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1182042294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f86b176-2564-4709-983c-20d31a3f56d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:52Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume 9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:52 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 Aug 26 00:25:52 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:52 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-7c32fa9d-b923-4a9a-8577-cb9b49b46730 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-d90849a8-f033-4a59-bf37-1b54d225155c-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:52 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 1073741824 Aug 26 00:25:52 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:52 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" returned: 0 in 0.514s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:52 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09 Aug 26 00:25:52 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:52 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 1073741824" returned: 0 in 0.623s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:53 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" returned: 0 in 0.399s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:53 devstack sudo[114778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 Aug 26 00:25:53 devstack sudo[114778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-quobyte-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09" released by "delete_volume" :: held 0.982s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Created reservations ['bcf07689-e6ea-4b99-960f-fa90772c0827', '5026ffd1-a670-4aca-992b-720489425c44', 'f771d1c6-8a31-4564-a54f-43a44160a9e3', '3e1aa8b9-9f58-46a8-875f-246ddd3dec71'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:53 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:25:53 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:53 devstack sudo[114778]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b004d48-2841-45de-8002-7023e3d13f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f86b176-2564-4709-983c-20d31a3f56d3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845b2be2-94dc-47c9-a469-f39fba9f4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-9f86b176-2564-4709-983c-20d31a3f56d3 (9f86b176-2564-4709-983c-20d31a3f56d3): created successfully Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845b2be2-94dc-47c9-a469-f39fba9f4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (a8c3fc7a-add6-4e5b-b416-2379f4f353f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-79dfd156-df80-4cad-b04a-bb4046dd137b tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:25:53 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.381s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:25:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Deleted volume successfully. Aug 26 00:25:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e21cf83c-0e68-4430-830b-a899f37fa4a6 tempest-VolumeDependencyTests-750789730 None] Lock "cinder-7cc0ef95-57e1-4bf3-aa02-13c1a74f4d09-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:25:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating offline snapshot 400eaab5-f4fc-43b5-81d5-255372eacd39 of volume 9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:25:54 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a10d2a-ddba-44b4-aa58-9e5d023ddaa1]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:25:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:54 devstack sudo[114784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 Aug 26 00:25:54 devstack sudo[114784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:55 devstack sudo[114784]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3" returned: 0 in 0.498s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:55 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 1G Aug 26 00:25:55 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:55 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 1G" returned: 0 in 0.588s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f86b176-2564-4709-983c-20d31a3f56d3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:55 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f86b176-2564-4709-983c-20d31a3f56d3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 Aug 26 00:25:55 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:56 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f86b176-2564-4709-983c-20d31a3f56d3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39" returned: 0 in 0.344s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:56 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 is being set with open permissions: ugo+rw Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:56 devstack sudo[114800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 Aug 26 00:25:56 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:56 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39" returned: 0 in 0.390s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:56 devstack sudo[114804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info Aug 26 00:25:56 devstack sudo[114804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (4f3c42ca-cad5-420a-9ad6-4194318714d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc66d26-5ca2-4e72-9f59-8e8913f5fe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdc66d26-5ca2-4e72-9f59-8e8913f5fe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626126381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7c49f3-0376-4ef0-ab0a-3b307c229465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:57Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd748bb-5e34-4c06-8177-13704fc6d180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd748bb-5e34-4c06-8177-13704fc6d180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95195a3-f4e1-4f97-81ca-9e790d91c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95195a3-f4e1-4f97-81ca-9e790d91c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d7c49f3-0376-4ef0-ab0a-3b307c229465', 'volume_name': 'volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07043d3-ed42-47a1-b256-4b7ad685fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07043d3-ed42-47a1-b256-4b7ad685fe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadbe7a5-674b-4889-8aa5-94851da0888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:56 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Volume 2d7c49f3-0376-4ef0-ab0a-3b307c229465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465', 'volume_size': 1} Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:56 devstack sudo[114804]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info" returned: 0 in 0.384s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:56 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info is being set with open permissions: ugo+rw Aug 26 00:25:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:56 devstack sudo[114807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info Aug 26 00:25:56 devstack sudo[114807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:57 devstack sudo[114807]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.info" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.475s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1626126381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d7c49f3-0376-4ef0-ab0a-3b307c229465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:57Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Creating volume 2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:57 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:57 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 1073741824 Aug 26 00:25:57 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:57 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7c665f71-9f07-4f05-a7f2-65bbea2aec14 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Create snapshot completed successfully Aug 26 00:25:57 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 1073741824" returned: 0 in 0.502s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:57 devstack sudo[114818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 Aug 26 00:25:57 devstack sudo[114818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:58 devstack sudo[114818]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465" returned: 0 in 0.322s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cadbe7a5-674b-4889-8aa5-94851da0888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225d323c-321b-4884-a0b8-e576d91be4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Volume volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 (2d7c49f3-0376-4ef0-ab0a-3b307c229465): created successfully Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225d323c-321b-4884-a0b8-e576d91be4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (4f3c42ca-cad5-420a-9ad6-4194318714d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b4584516-6952-4be9-99fc-5c48fb04a703 tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (a8a78aa8-f831-489a-90f8-8964b9304ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7774ae49-0e24-4cca-8534-da6010cfa3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7774ae49-0e24-4cca-8534-da6010cfa3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975402624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a006e4fb-47c6-4d4e-82ef-13d61e590528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:58Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a42105-815d-41b3-9c6b-1cc1a6cb535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a42105-815d-41b3-9c6b-1cc1a6cb535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a999f51c-293c-4b88-856e-9e7aae5a5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a999f51c-293c-4b88-856e-9e7aae5a5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a006e4fb-47c6-4d4e-82ef-13d61e590528', 'volume_name': 'volume-a006e4fb-47c6-4d4e-82ef-13d61e590528', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca72a39a-e949-4512-90eb-e07642248e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca72a39a-e949-4512-90eb-e07642248e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d49570-c778-46f0-bcb5-5fcb65513894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume a006e4fb-47c6-4d4e-82ef-13d61e590528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a006e4fb-47c6-4d4e-82ef-13d61e590528', 'volume_size': 1} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975402624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a006e4fb-47c6-4d4e-82ef-13d61e590528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:58Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume a006e4fb-47c6-4d4e-82ef-13d61e590528 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:25:58 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:58 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 1073741824 Aug 26 00:25:58 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Flow 'volume_create_manager' (20bdd2f5-72a0-4328-90f3-b7aa15255af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a3d1d1-4b20-4c95-9e08-f0adf56c3d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a3d1d1-4b20-4c95-9e08-f0adf56c3d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8497cf-dbf0-43d4-a0b1-547286cdcf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25c8a9365ea4c2cb975266242614bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='a33a54855cde4071a6d3f4b459c8589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5007a42b-8ae2-4d8d-9241-e9c9aff98530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5007a42b-8ae2-4d8d-9241-e9c9aff98530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2825ac-c917-4bca-a6bd-a25c0018d944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2825ac-c917-4bca-a6bd-a25c0018d944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8497cf-dbf0-43d4-a0b1-547286cdcf9d', 'volume_name': 'volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4609ed-bb16-489f-bf85-3fd361cb296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e4609ed-bb16-489f-bf85-3fd361cb296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987e468-cc79-44e5-8009-f3853f4df0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:58 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Volume 0f8497cf-dbf0-43d4-a0b1-547286cdcf9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d', 'volume_size': 1} Aug 26 00:25:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (8728f2c6-0a52-4416-a5dd-2163605caf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939b7ad-73a1-4cc7-8b13-23b8fd388a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a939b7ad-73a1-4cc7-8b13-23b8fd388a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295451487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43e44a5-c164-4033-b603-5a5394aeb86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354584de-6360-45ba-bec2-70acecbd6219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (354584de-6360-45ba-bec2-70acecbd6219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f759dc6-91b9-42d3-98e3-260e89e1b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f759dc6-91b9-42d3-98e3-260e89e1b163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43e44a5-c164-4033-b603-5a5394aeb86e', 'volume_name': 'volume-a43e44a5-c164-4033-b603-5a5394aeb86e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a145de-b693-4b99-89a0-5daa87ee39db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1a145de-b693-4b99-89a0-5daa87ee39db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556376e4-7222-4886-a7fc-39f1460b535e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume a43e44a5-c164-4033-b603-5a5394aeb86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43e44a5-c164-4033-b603-5a5394aeb86e', 'volume_size': 1} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (147ceb77-bc24-4bb9-bbb2-579a804da663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb51d12-3f21-4fa2-8ada-0961a848a712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 1073741824" returned: 0 in 0.766s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb51d12-3f21-4fa2-8ada-0961a848a712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520132574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19b6387-423d-4245-ab30-b8cd4204f898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d4ce89-9afd-4c4a-9ba3-58956066766d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5d4ce89-9afd-4c4a-9ba3-58956066766d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356029b7-b36c-4cd7-b809-743cf4397f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356029b7-b36c-4cd7-b809-743cf4397f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19b6387-423d-4245-ab30-b8cd4204f898', 'volume_name': 'volume-e19b6387-423d-4245-ab30-b8cd4204f898', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca28b87-0c50-433b-91c5-644a6639f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca28b87-0c50-433b-91c5-644a6639f46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1067da64-5d1e-4b26-bcc6-9862fb7fe281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume e19b6387-423d-4245-ab30-b8cd4204f898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19b6387-423d-4245-ab30-b8cd4204f898', 'volume_size': 1} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:25:59 devstack sudo[114828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 Aug 26 00:25:59 devstack sudo[114828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (e13f2a62-737f-49b6-8b23-84491c307562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b4c37-0279-43d6-8c2d-2852f0dcda05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b4c37-0279-43d6-8c2d-2852f0dcda05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260827563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a448acc9-d789-4bf3-8be6-0d10091e64ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:00Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a93d743-91d2-48a2-973e-99c835babec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a93d743-91d2-48a2-973e-99c835babec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47875995-9d0e-4d10-b07b-1b57be52619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47875995-9d0e-4d10-b07b-1b57be52619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a448acc9-d789-4bf3-8be6-0d10091e64ce', 'volume_name': 'volume-a448acc9-d789-4bf3-8be6-0d10091e64ce', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfdb3ee-adf4-4d73-9d43-11b7efaa9972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dfdb3ee-adf4-4d73-9d43-11b7efaa9972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d6a0d-0a4e-464d-8956-f39df8214594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:25:59 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume a448acc9-d789-4bf3-8be6-0d10091e64ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a448acc9-d789-4bf3-8be6-0d10091e64ce', 'volume_size': 1} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack sudo[114828]: pam_unix(sudo:session): session closed for user root Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528" returned: 0 in 0.330s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.046s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8497cf-dbf0-43d4-a0b1-547286cdcf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25c8a9365ea4c2cb975266242614bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='a33a54855cde4071a6d3f4b459c8589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Creating volume 0f8497cf-dbf0-43d4-a0b1-547286cdcf9d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:25:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00d49570-c778-46f0-bcb5-5fcb65513894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a006e4fb-47c6-4d4e-82ef-13d61e590528', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02794c65-1d35-467b-986b-fd300c065715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack sudo[114831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d 1073741824 Aug 26 00:26:00 devstack sudo[114831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 (a006e4fb-47c6-4d4e-82ef-13d61e590528): created successfully Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02794c65-1d35-467b-986b-fd300c065715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (a8a78aa8-f831-489a-90f8-8964b9304ece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d13e96da-8fc8-4061-a1a4-4113efdd6a85 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (4e296d6e-83a5-40d4-8900-87522aa1807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d7400d-38c6-434d-b71e-8dc1fff7ee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d7400d-38c6-434d-b71e-8dc1fff7ee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790178529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68292da1-072e-4456-910c-7cc6bbc9806f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:00Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a13eb9-2dcc-4b10-97a8-3034346c4016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a13eb9-2dcc-4b10-97a8-3034346c4016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a81159a-e234-44bf-806f-6b037999b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a81159a-e234-44bf-806f-6b037999b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68292da1-072e-4456-910c-7cc6bbc9806f', 'volume_name': 'volume-68292da1-072e-4456-910c-7cc6bbc9806f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c3009-94e7-4d1b-b1bd-b93d9a307989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c3009-94e7-4d1b-b1bd-b93d9a307989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271686e6-aa60-482d-8e70-77e276699804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume 68292da1-072e-4456-910c-7cc6bbc9806f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68292da1-072e-4456-910c-7cc6bbc9806f', 'volume_size': 1} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:00 devstack sudo[114831]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d 1073741824" returned: 0 in 0.504s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:00 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d Aug 26 00:26:00 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:00 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" returned: 0 in 0.241s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.559s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-295451487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43e44a5-c164-4033-b603-5a5394aeb86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume a43e44a5-c164-4033-b603-5a5394aeb86e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5987e468-cc79-44e5-8009-f3853f4df0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack sudo[114840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e 1073741824 Aug 26 00:26:00 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee280db5-54fa-42e7-8436-e29e63aefd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Volume volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d (0f8497cf-dbf0-43d4-a0b1-547286cdcf9d): created successfully Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee280db5-54fa-42e7-8436-e29e63aefd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Flow 'volume_create_manager' (20bdd2f5-72a0-4328-90f3-b7aa15255af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-56f9493f-923a-43f9-9b5b-e7448f5e56af tempest-CinderUnicodeTest-842368928 None] Created volume successfully. Aug 26 00:26:01 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e 1073741824" returned: 0 in 0.478s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:01 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e Aug 26 00:26:01 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:01 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1520132574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19b6387-423d-4245-ab30-b8cd4204f898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:25:59Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume e19b6387-423d-4245-ab30-b8cd4204f898 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:01 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556376e4-7222-4886-a7fc-39f1460b535e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43e44a5-c164-4033-b603-5a5394aeb86e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca81e5f8-5836-4a17-ba72-913a8502b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:01 devstack sudo[114848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 1073741824 Aug 26 00:26:01 devstack sudo[114848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-a43e44a5-c164-4033-b603-5a5394aeb86e (a43e44a5-c164-4033-b603-5a5394aeb86e): created successfully Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca81e5f8-5836-4a17-ba72-913a8502b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (8728f2c6-0a52-4416-a5dd-2163605caf27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-aa079041-fe63-4fed-802f-7b946ecea865 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:26:02 devstack sudo[114848]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 1073741824" returned: 0 in 0.550s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:02 devstack sudo[114853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 Aug 26 00:26:02 devstack sudo[114853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Flow 'volume_create_manager' (0072df7e-9d93-4397-a111-312b8b7321e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0c1cf-83b3-4816-83f0-6e377e12c5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c0c1cf-83b3-4816-83f0-6e377e12c5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945562246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7d77ae-2e74-49fc-acf3-2a91f095cdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25c8a9365ea4c2cb975266242614bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:02Z,use_quota=True,user_id='a33a54855cde4071a6d3f4b459c8589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd2f863-22a4-48a6-8853-bc6d28a03cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd2f863-22a4-48a6-8853-bc6d28a03cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c1d7e-cb03-405d-8a0b-d5220b30fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708c1d7e-cb03-405d-8a0b-d5220b30fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7d77ae-2e74-49fc-acf3-2a91f095cdd3', 'volume_name': 'volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc62f54-aeca-405b-a90e-9c516ebdb479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc62f54-aeca-405b-a90e-9c516ebdb479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03766492-6d30-4e16-acb9-51fb4809d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Volume 8b7d77ae-2e74-49fc-acf3-2a91f095cdd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3', 'volume_size': 1} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:02 devstack sudo[114853]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.809s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1067da64-5d1e-4b26-bcc6-9862fb7fe281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19b6387-423d-4245-ab30-b8cd4204f898', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219b64fe-ae8d-44c3-96b6-f77ec19d7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot b6e36ae1-efe9-4efb-91a1-a1484d9eca34 of volume 2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec1f599-8ccf-45ca-98d8-262b48ea1647]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:02 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-e19b6387-423d-4245-ab30-b8cd4204f898 (e19b6387-423d-4245-ab30-b8cd4204f898): created successfully Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (219b64fe-ae8d-44c3-96b6-f77ec19d7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (147ceb77-bc24-4bb9-bbb2-579a804da663) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:02 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-33e37fa7-5f5a-459e-8cd5-2cd261a39589 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:26:02 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 Aug 26 00:26:02 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:02 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465" returned: 0 in 0.381s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:02 devstack sudo[114895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 1G Aug 26 00:26:02 devstack sudo[114895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:03 devstack sudo[114895]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 1G" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:03 devstack sudo[114902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 Aug 26 00:26:03 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:03 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34" returned: 0 in 0.310s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:03 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 is being set with open permissions: ugo+rw Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:03 devstack sudo[114908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 Aug 26 00:26:03 devstack sudo[114908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:03 devstack sudo[114908]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34" returned: 0 in 0.244s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:03 devstack sudo[114911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info Aug 26 00:26:03 devstack sudo[114911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:04 devstack sudo[114911]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:04 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info is being set with open permissions: ugo+rw Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:04 devstack sudo[114914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info Aug 26 00:26:04 devstack sudo[114914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:04 devstack sudo[114914]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.info" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.538s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-260827563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a448acc9-d789-4bf3-8be6-0d10091e64ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:00Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume a448acc9-d789-4bf3-8be6-0d10091e64ce {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:04 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:04 devstack sudo[114917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce 1073741824 Aug 26 00:26:04 devstack sudo[114917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:04 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c66d4cb7-57d4-46b2-875f-a2fb5473d097 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-b6e36ae1-efe9-4efb-91a1-a1484d9eca34-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-b6e36ae1-efe9-4efb-91a1-a1484d9eca34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-b6e36ae1-efe9-4efb-91a1-a1484d9eca34" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-b6e36ae1-efe9-4efb-91a1-a1484d9eca34" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot b6e36ae1-efe9-4efb-91a1-a1484d9eca34 of volume 2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[019f1915-57e9-4204-942f-969de236891f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:04 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 Aug 26 00:26:04 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:04 devstack sudo[114917]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce 1073741824" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:04 devstack sudo[114925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce Aug 26 00:26:04 devstack sudo[114925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:05 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb10ce0-0bd6-4d3e-b816-7ef4177da77e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:05 devstack sudo[114925]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.853s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1790178529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68292da1-072e-4456-910c-7cc6bbc9806f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9233af18650b41b6abd3350d3c2fcf61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:00Z,use_quota=True,user_id='976e1f17aa9140b8896f7e68eebee1e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Creating volume 68292da1-072e-4456-910c-7cc6bbc9806f {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:05 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045d6a0d-0a4e-464d-8956-f39df8214594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a448acc9-d789-4bf3-8be6-0d10091e64ce', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a378e929-caa4-4a57-8401-d94b7bac2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:05 devstack sudo[114932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f 1073741824 Aug 26 00:26:05 devstack sudo[114932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:05 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-a448acc9-d789-4bf3-8be6-0d10091e64ce (a448acc9-d789-4bf3-8be6-0d10091e64ce): created successfully Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a378e929-caa4-4a57-8401-d94b7bac2729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:05 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 Aug 26 00:26:05 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (e13f2a62-737f-49b6-8b23-84491c307562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-44b6a84a-1cd6-4dbb-999f-cebbdb00db8d tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:26:05 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:05 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 Aug 26 00:26:05 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:05 devstack sudo[114932]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f 1073741824" returned: 0 in 0.550s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:05 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f Aug 26 00:26:05 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:05 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34" returned: 0 in 0.427s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:05 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34 Aug 26 00:26:05 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:06 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f" returned: 0 in 0.288s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.620s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945562246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7d77ae-2e74-49fc-acf3-2a91f095cdd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f25c8a9365ea4c2cb975266242614bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:02Z,use_quota=True,user_id='a33a54855cde4071a6d3f4b459c8589d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Creating volume 8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:06 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271686e6-aa60-482d-8e70-77e276699804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68292da1-072e-4456-910c-7cc6bbc9806f', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952c633b-3cb9-47d7-a2a5-9636b8bcc171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:06 devstack sudo[114952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 1073741824 Aug 26 00:26:06 devstack sudo[114952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Volume volume-68292da1-072e-4456-910c-7cc6bbc9806f (68292da1-072e-4456-910c-7cc6bbc9806f): created successfully Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (952c633b-3cb9-47d7-a2a5-9636b8bcc171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Flow 'volume_create_manager' (4e296d6e-83a5-40d4-8900-87522aa1807b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8e177d2e-e398-462e-a3f9-8dc7f54936a2 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created volume successfully. Aug 26 00:26:06 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465.b6e36ae1-efe9-4efb-91a1-a1484d9eca34" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-b6e36ae1-efe9-4efb-91a1-a1484d9eca34" released by "_delete_snapshot" :: held 1.559s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" released by "delete_snapshot" :: held 1.580s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Created reservations ['cabccfef-3a5c-4770-84ea-bb8755dd5518', '6672350e-77b6-442c-a6c4-3879b18ff8d9', 'c2acf7c8-0bdc-40ea-a250-782420d0cfbe', '2836564e-48b9-463e-9447-5a2d145837ac'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a41a168c-cf79-4265-96fa-acd1a943d515 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-b6e36ae1-efe9-4efb-91a1-a1484d9eca34-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:06 devstack sudo[114952]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 1073741824" returned: 0 in 0.505s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:06 devstack sudo[114958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 Aug 26 00:26:06 devstack sudo[114958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-68292da1-072e-4456-910c-7cc6bbc9806f-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-2d7c49f3-0376-4ef0-ab0a-3b307c229465-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-68292da1-072e-4456-910c-7cc6bbc9806f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-2d7c49f3-0376-4ef0-ab0a-3b307c229465-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-68292da1-072e-4456-910c-7cc6bbc9806f" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:06 devstack sudo[114958]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" returned: 0 in 0.351s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-68292da1-072e-4456-910c-7cc6bbc9806f" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" acquired by "delete_volume" :: waited 0.035s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c245e8-ed07-4191-aa1e-999ab8689309]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3558372-4001-41e6-b745-90566b8db859]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03766492-6d30-4e16-acb9-51fb4809d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e65278-b5a2-4c61-a849-96608b41e567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:07 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Volume volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 (8b7d77ae-2e74-49fc-acf3-2a91f095cdd3): created successfully Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e65278-b5a2-4c61-a849-96608b41e567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Flow 'volume_create_manager' (0072df7e-9d93-4397-a111-312b8b7321e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:07 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d18e52ce-67eb-4e41-bbe9-c3e3263aa911 tempest-CinderUnicodeTest-842368928 None] Created volume successfully. Aug 26 00:26:07 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f Aug 26 00:26:07 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:07 devstack sudo[114962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 Aug 26 00:26:07 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f" returned: 0 in 0.436s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:07 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:07 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465" returned: 0 in 0.435s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:07 devstack sudo[114972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f Aug 26 00:26:07 devstack sudo[114972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:07 devstack sudo[114973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465 Aug 26 00:26:07 devstack sudo[114973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:07 devstack sudo[114972]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-68292da1-072e-4456-910c-7cc6bbc9806f" returned: 0 in 0.301s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-68292da1-072e-4456-910c-7cc6bbc9806f" released by "delete_volume" :: held 0.803s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:07 devstack sudo[114973]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-2d7c49f3-0376-4ef0-ab0a-3b307c229465" returned: 0 in 0.318s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-2d7c49f3-0376-4ef0-ab0a-3b307c229465" released by "delete_volume" :: held 0.827s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['8bb06706-6480-4fea-9429-ab023254c9f4', 'dac67d80-4f73-4b08-8cca-715156ba0fb6', 'ada2b8dd-c045-46b0-ab4a-cdef1ff43f2b', '9dc10aa7-fe25-43ef-8864-a92084b38fcb'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Created reservations ['a6c88cee-97af-415c-afef-65b66547606e', 'f38528a5-857b-40a7-821e-8deb5edc661a', 'daa4bc8a-e1a6-4a7a-9323-e8113113a5c5', 'a7255a9b-3af5-45d0-9ace-fd8f70cc6e32'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Creating offline snapshot ea5ccc42-9236-4136-a94a-5156e13f5f46 of volume 8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25acd9a-f221-41e0-94b2-4acd798bde31]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-a448acc9-d789-4bf3-8be6-0d10091e64ce-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:08 devstack sudo[114983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:08 devstack sudo[114983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a448acc9-d789-4bf3-8be6-0d10091e64ce-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:08 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:08 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:08 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 Aug 26 00:26:08 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-a448acc9-d789-4bf3-8be6-0d10091e64ce" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a448acc9-d789-4bf3-8be6-0d10091e64ce" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[75160ba8-4c8d-42ce-bc2a-3598d505e457]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack sudo[114991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce Aug 26 00:26:08 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:08 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" returned: 0 in 0.526s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack sudo[114983]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.512s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:08 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:08 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.423s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:08 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:26:08 devstack sudo[114998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 1G Aug 26 00:26:08 devstack sudo[114998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-db1c20f8-9721-4894-87b7-408d6097862e tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-68292da1-072e-4456-910c-7cc6bbc9806f-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33bd1722-005c-4de5-842e-d4bec4720cf0 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-2d7c49f3-0376-4ef0-ab0a-3b307c229465-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:08 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce" returned: 0 in 0.452s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:08 devstack sudo[115003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce Aug 26 00:26:08 devstack sudo[115003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:09 devstack sudo[114998]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 1G" returned: 0 in 0.489s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:09 devstack sudo[115003]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a448acc9-d789-4bf3-8be6-0d10091e64ce" returned: 0 in 0.299s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:09 devstack sudo[115009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 Aug 26 00:26:09 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a448acc9-d789-4bf3-8be6-0d10091e64ce" released by "delete_volume" :: held 0.823s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['df0971ed-1ba4-4972-baec-9532f1671d85', '193e327d-a7c3-4c1f-adc5-511ee6fa9ce3', 'e674d775-3853-48c2-ae40-256e006a4b34', 'd1c64b54-9fe5-4089-8e13-fa5ac1577782'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:09 devstack sudo[115011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:09 devstack sudo[115011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-e19b6387-423d-4245-ab30-b8cd4204f898-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-e19b6387-423d-4245-ab30-b8cd4204f898-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-e19b6387-423d-4245-ab30-b8cd4204f898" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-e19b6387-423d-4245-ab30-b8cd4204f898" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:09 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ba2f1e-2896-4496-b1e7-6198e128f882]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46" returned: 0 in 0.534s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:09 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 is being set with open permissions: ugo+rw Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:09 devstack sudo[115020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 Aug 26 00:26:09 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:09 devstack sudo[115011]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.379s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3ebd9815-c079-4428-b565-86aa25c69333 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a448acc9-d789-4bf3-8be6-0d10091e64ce-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:09 devstack sudo[115018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 Aug 26 00:26:09 devstack sudo[115018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (ac6cbcda-274e-4c59-b8e7-2743674622e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ded818e-8cdc-4497-9ad8-3bd9ee3b7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ded818e-8cdc-4497-9ad8-3bd9ee3b7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824034945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f755035b-c323-4bd3-8e3b-985e84d33e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:10Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da23a-6a69-47a4-aece-dddebd7813eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052da23a-6a69-47a4-aece-dddebd7813eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb36b86-4b67-45ab-8e79-72825f71c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bb36b86-4b67-45ab-8e79-72825f71c737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f755035b-c323-4bd3-8e3b-985e84d33e68', 'volume_name': 'volume-f755035b-c323-4bd3-8e3b-985e84d33e68', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3504db5d-6544-4e93-b969-8805d5f13fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3504db5d-6544-4e93-b969-8805d5f13fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4cb00c-ea0d-42be-92b9-a51a0d14e769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:09 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Volume f755035b-c323-4bd3-8e3b-985e84d33e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f755035b-c323-4bd3-8e3b-985e84d33e68', 'volume_size': 1} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:09 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info Aug 26 00:26:10 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:10 devstack sudo[115018]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898" returned: 0 in 0.461s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack sudo[115029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898 Aug 26 00:26:10 devstack sudo[115029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:10 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info" returned: 0 in 0.294s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:10 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info is being set with open permissions: ugo+rw Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack sudo[115029]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e19b6387-423d-4245-ab30-b8cd4204f898" returned: 0 in 0.272s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:10 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info Aug 26 00:26:10 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-e19b6387-423d-4245-ab30-b8cd4204f898" released by "delete_volume" :: held 0.801s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['d470543b-e9e0-4176-981d-12df736cd749', 'fccb5400-a915-4f75-91cc-9eee70021fdd', 'e4f65a46-feb2-4220-b0db-828fa91ba405', 'c02455db-e429-4204-8b44-76b093ff1b8b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:10 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:10 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.info" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.704s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.747s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824034945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f755035b-c323-4bd3-8e3b-985e84d33e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:10Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Creating volume f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:10 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-a43e44a5-c164-4033-b603-5a5394aeb86e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:10 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 1073741824 Aug 26 00:26:10 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a43e44a5-c164-4033-b603-5a5394aeb86e-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-035a9829-4b44-45b2-85c7-da1cf6312916 tempest-CinderUnicodeTest-842368928 None] Create snapshot completed successfully Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-a43e44a5-c164-4033-b603-5a5394aeb86e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a43e44a5-c164-4033-b603-5a5394aeb86e" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16ff04a-3dd6-46c6-b538-80458d0773a5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:10 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.403s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:10 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bc750d36-b43c-4c83-ba7f-3be1540dfdd5 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-e19b6387-423d-4245-ab30-b8cd4204f898-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:11 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e Aug 26 00:26:11 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-ea5ccc42-9236-4136-a94a-5156e13f5f46-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-ea5ccc42-9236-4136-a94a-5156e13f5f46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-quobyte-ea5ccc42-9236-4136-a94a-5156e13f5f46" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-ea5ccc42-9236-4136-a94a-5156e13f5f46" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Deleting offline snapshot ea5ccc42-9236-4136-a94a-5156e13f5f46 of volume 8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] snapshot_file for this snap is: volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[858b43ea-844a-4e35-acc0-e4c9ade6d5d8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:11 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 1073741824" returned: 0 in 0.626s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:11 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e" returned: 0 in 0.509s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:11 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 Aug 26 00:26:11 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:11 devstack sudo[115053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e Aug 26 00:26:11 devstack sudo[115053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:11 devstack sudo[115047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 Aug 26 00:26:11 devstack sudo[115047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:11 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68" returned: 0 in 0.304s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:11 devstack sudo[115053]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a43e44a5-c164-4033-b603-5a5394aeb86e" returned: 0 in 0.292s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa4cb00c-ea0d-42be-92b9-a51a0d14e769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f755035b-c323-4bd3-8e3b-985e84d33e68', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac1f7be-ab37-467d-be9e-d99c025879a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a43e44a5-c164-4033-b603-5a5394aeb86e" released by "delete_volume" :: held 0.862s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:11 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Volume volume-f755035b-c323-4bd3-8e3b-985e84d33e68 (f755035b-c323-4bd3-8e3b-985e84d33e68): created successfully Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac1f7be-ab37-467d-be9e-d99c025879a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (ac6cbcda-274e-4c59-b8e7-2743674622e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:11 devstack sudo[115047]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46" returned: 0 in 0.488s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f273d4f0-5ea0-4f89-80f6-852eb2c01f7c tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638d2fa-1b23-4072-a89d-662e3486fb38]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['f458faad-8751-4a87-adfb-b9a0ea2fa872', 'b460c2bb-a84a-4d6d-ac61-97fd7bbec42b', 'c885b149-0818-4059-81df-a5083688bd88', '8a2e911b-3197-4d84-8cf1-7059bb4e953e'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:11 devstack sudo[115062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 Aug 26 00:26:11 devstack sudo[115062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:11 devstack sudo[115064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:11 devstack sudo[115064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot 379ec331-4842-4235-b94b-4f710d48cf5f of volume f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2575c4-b1d0-4314-8413-33bcb9469637]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:12 devstack sudo[115062]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" returned: 0 in 0.478s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:12 devstack sudo[115064]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.356s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:12 devstack sudo[115071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 Aug 26 00:26:12 devstack sudo[115071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:12 devstack sudo[115068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 Aug 26 00:26:12 devstack sudo[115068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0a547112-d097-4874-9050-3b11fb7635c4 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a43e44a5-c164-4033-b603-5a5394aeb86e-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:12 devstack sudo[115068]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68" returned: 0 in 0.427s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:12 devstack sudo[115081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f 1G Aug 26 00:26:12 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:12 devstack sudo[115071]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:12 devstack sudo[115083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46 Aug 26 00:26:12 devstack sudo[115083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-a006e4fb-47c6-4d4e-82ef-13d61e590528-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a006e4fb-47c6-4d4e-82ef-13d61e590528-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:13 devstack sudo[115083]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-a006e4fb-47c6-4d4e-82ef-13d61e590528" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3.ea5ccc42-9236-4136-a94a-5156e13f5f46" returned: 0 in 0.339s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a006e4fb-47c6-4d4e-82ef-13d61e590528" acquired by "delete_volume" :: waited 0.048s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-ea5ccc42-9236-4136-a94a-5156e13f5f46" released by "_delete_snapshot" :: held 1.874s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" released by "delete_snapshot" :: held 1.907s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1f9588-429c-4e72-a039-8884b75f535e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:13 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f 1G" returned: 0 in 0.588s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755035b-c323-4bd3-8e3b-985e84d33e68 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:13 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755035b-c323-4bd3-8e3b-985e84d33e68 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f Aug 26 00:26:13 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Created reservations ['669b0da5-2267-4fa0-bd7f-0b607e6f0061', '54d4c784-6cb6-4610-bef3-2f8dd2262409', '7d1723a0-6b4a-49e6-9000-6712f4375891', '3e9ccca8-1a08-4bb0-9a57-4c53d86fb729'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:13 devstack sudo[115090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 Aug 26 00:26:13 devstack sudo[115090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Delete snapshot completed successfully. Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-da37e15a-92b6-4445-a713-8288b36f94df tempest-CinderUnicodeTest-842368928 None] Lock "cinder-ea5ccc42-9236-4136-a94a-5156e13f5f46-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:13 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f755035b-c323-4bd3-8e3b-985e84d33e68 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f" returned: 0 in 0.327s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f is being set with open permissions: ugo+rw Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:13 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f Aug 26 00:26:13 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:13 devstack sudo[115090]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528" returned: 0 in 0.500s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:13 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528 Aug 26 00:26:13 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:13 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:13 devstack sudo[115105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info Aug 26 00:26:13 devstack sudo[115105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:13 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a006e4fb-47c6-4d4e-82ef-13d61e590528" returned: 0 in 0.284s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-a006e4fb-47c6-4d4e-82ef-13d61e590528" released by "delete_volume" :: held 0.854s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['f5cae39e-d52c-411d-92da-fefb15de7c3d', 'eeca81cb-e02d-49ab-9f18-290ae0717725', '62352797-225a-442a-b045-3f8703fa16a9', 'b4f57050-1468-4c85-8300-d20165508722'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:14 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:14 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:14 devstack sudo[115105]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info" returned: 0 in 0.285s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:14 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info is being set with open permissions: ugo+rw Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:14 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info Aug 26 00:26:14 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-400eaab5-f4fc-43b5-81d5-255372eacd39-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-400eaab5-f4fc-43b5-81d5-255372eacd39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-400eaab5-f4fc-43b5-81d5-255372eacd39" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-400eaab5-f4fc-43b5-81d5-255372eacd39" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleting offline snapshot 400eaab5-f4fc-43b5-81d5-255372eacd39 of volume 9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] snapshot_file for this snap is: volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabe65b0-df8e-407e-aeee-1c32abb0cad4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:14 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.471s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:14 devstack sudo[115113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 Aug 26 00:26:14 devstack sudo[115113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-33f3ce4f-e921-4bda-967f-52c2ff47b459 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-a006e4fb-47c6-4d4e-82ef-13d61e590528-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "cinder-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:14 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.info" returned: 0 in 0.651s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.626s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[623fe7cc-9581-495f-941c-c6f9bb19db75]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-2e42e935-3de7-4fcb-87cf-acde4406afa1 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:26:14 devstack sudo[115113]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39" returned: 0 in 0.589s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f86b176-2564-4709-983c-20d31a3f56d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:14 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 Aug 26 00:26:14 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9519272e-90a8-499d-8a84-572f1dc724e0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:15 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 Aug 26 00:26:15 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:15 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" returned: 0 in 0.433s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:15 devstack sudo[115128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3 Aug 26 00:26:15 devstack sudo[115128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:15 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3" returned: 0 in 0.436s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-379ec331-4842-4235-b94b-4f710d48cf5f-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:15 devstack sudo[115133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 Aug 26 00:26:15 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-379ec331-4842-4235-b94b-4f710d48cf5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-379ec331-4842-4235-b94b-4f710d48cf5f" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-379ec331-4842-4235-b94b-4f710d48cf5f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot 379ec331-4842-4235-b94b-4f710d48cf5f of volume f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee0c6f-3b14-4dbe-90ee-ce99e2839d2b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:15 devstack sudo[115128]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" returned: 0 in 0.445s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3" released by "delete_volume" :: held 0.947s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:15 devstack sudo[115135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f Aug 26 00:26:15 devstack sudo[115135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Created reservations ['509a039f-c8ce-4a6b-8f2c-2fc6ae59a66d', 'ac407172-78a7-420b-8851-d01b704d8d3c', 'c6a735fe-8f53-4c19-a899-1de2324e51eb', '5fac30bb-d592-4afc-8a15-b63f10b44824'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:15 devstack sudo[115141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:15 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:15 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39" returned: 0 in 0.591s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:16 devstack sudo[115143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39 Aug 26 00:26:16 devstack sudo[115143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:16 devstack sudo[115135]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f" returned: 0 in 0.619s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f755035b-c323-4bd3-8e3b-985e84d33e68(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:16 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.319s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0231d382-7916-42ab-9e24-038376b7f1de]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Deleted volume successfully. Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-648056a7-5f0b-45d0-af98-f8a5d570187c tempest-CinderUnicodeTest-842368928 None] Lock "cinder-8b7d77ae-2e74-49fc-acf3-2a91f095cdd3-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:16 devstack sudo[115149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 Aug 26 00:26:16 devstack sudo[115149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:16 devstack sudo[115143]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3.400eaab5-f4fc-43b5-81d5-255372eacd39" returned: 0 in 0.470s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-400eaab5-f4fc-43b5-81d5-255372eacd39" released by "_delete_snapshot" :: held 2.250s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" released by "delete_snapshot" :: held 2.298s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['8b237672-2bcf-4e44-9e85-737a25f97e11', '0cbca8c5-3b1e-40af-acb0-9823a6e3e2b3', '1aba574f-63ea-4a4c-8457-ae5e917e1d2d', '781f9690-57ef-4903-899e-cbbe90faa1bc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Delete snapshot completed successfully. Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-b1eb3ae8-f0f1-4f9c-bedc-986c3e80e103 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-400eaab5-f4fc-43b5-81d5-255372eacd39-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:16 devstack sudo[115149]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68" returned: 0 in 0.494s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:16 devstack sudo[115155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f Aug 26 00:26:16 devstack sudo[115155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "cinder-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "cinder-quobyte-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" acquired by "delete_volume" :: waited 0.027s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3acdd3-299b-4f6e-985f-e22c4478262f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:17 devstack sudo[115155]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f" returned: 0 in 0.442s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:17 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f Aug 26 00:26:17 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:17 devstack sudo[115160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d Aug 26 00:26:17 devstack sudo[115160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:17 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68.379ec331-4842-4235-b94b-4f710d48cf5f" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-9f86b176-2564-4709-983c-20d31a3f56d3-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-379ec331-4842-4235-b94b-4f710d48cf5f" released by "_delete_snapshot" :: held 2.006s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:17 devstack sudo[115160]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" released by "delete_snapshot" :: held 2.109s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" returned: 0 in 0.495s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-9f86b176-2564-4709-983c-20d31a3f56d3-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:17 devstack sudo[115168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d Aug 26 00:26:17 devstack sudo[115168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Created reservations ['6c5c365a-a0ea-42fe-8fc8-0e74efad3ac2', 'aebac0dd-d549-4298-a216-72ecd87701ae', 'f29ce93d-8525-4b86-84f7-772790ef3aa3', '3c6c2d95-c706-4dc0-8f41-d6c3dc634423'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f477954a-d483-4d3e-89b5-da2a7414dd6d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c00902e6-581a-46be-80a9-8156f37cf252 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-379ec331-4842-4235-b94b-4f710d48cf5f-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:17 devstack sudo[115168]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" returned: 0 in 0.343s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "cinder-quobyte-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d" released by "delete_volume" :: held 0.891s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:17 devstack sudo[115170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 Aug 26 00:26:17 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Created reservations ['b2ef07db-ec7f-44de-86a0-dde134e302da', '76773dd1-c379-4eb5-9c75-904162426040', 'bc870cd5-6e35-46ef-9c80-89022df38313', 'e6c32802-65ea-4ecb-a4e0-2908f94292b9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:18 devstack sudo[115174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:18 devstack sudo[115174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:18 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3" returned: 0 in 0.576s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:18 devstack sudo[115179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3 Aug 26 00:26:18 devstack sudo[115179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:18 devstack sudo[115174]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.523s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:18 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Deleted volume successfully. Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-795381d1-5d3f-4833-a02c-a2b9ef660723 tempest-CinderUnicodeTest-842368928 None] Lock "cinder-0f8497cf-dbf0-43d4-a0b1-547286cdcf9d-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:18 devstack sudo[115179]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-f755035b-c323-4bd3-8e3b-985e84d33e68-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9f86b176-2564-4709-983c-20d31a3f56d3" returned: 0 in 0.511s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-quobyte-9f86b176-2564-4709-983c-20d31a3f56d3" released by "delete_volume" :: held 1.204s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "cinder-f755035b-c323-4bd3-8e3b-985e84d33e68-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:18 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Created reservations ['58f40f40-b7bb-45e7-86b3-9f7570bbf6df', '3b48c2eb-bf84-4baf-b0f6-66ef67fd5605', '64e5f70a-e523-4a69-b8ea-f822357815a8', '23220548-4fa3-4eea-9b0f-393749131e6c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[a404a7aa-bb8f-47f6-a138-de12116042e9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:19 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 Aug 26 00:26:19 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:19 devstack sudo[115185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:19 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:19 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68" returned: 0 in 0.454s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:19 devstack sudo[115191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68 Aug 26 00:26:19 devstack sudo[115191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:19 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.314s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Deleted volume successfully. Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0cac1c51-e75b-4109-8659-acd3c2e82bc6 tempest-CreateVolumesFromSnapshotTest-1873408133 None] Lock "cinder-9f86b176-2564-4709-983c-20d31a3f56d3-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:19 devstack sudo[115191]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-f755035b-c323-4bd3-8e3b-985e84d33e68" returned: 0 in 0.362s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f755035b-c323-4bd3-8e3b-985e84d33e68" released by "delete_volume" :: held 0.914s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Created reservations ['3e0ac27e-3225-4529-9d68-5232a22ebc6f', 'd16c87f6-1461-4553-b1bb-772840657ee8', 'df87810e-782a-460a-9050-1b58fe65766a', '28fbd886-e076-4fc7-ad14-a4d3eff68e55'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:20 devstack sudo[115196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:20 devstack sudo[115196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:20 devstack sudo[115196]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.390s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:20 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:26:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-eff5531b-db1a-45c5-bca3-f55c4189301b tempest-ProjectMemberTests-1845745940 None] Lock "cinder-f755035b-c323-4bd3-8e3b-985e84d33e68-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (b84085ff-a33d-4665-a880-f46d042f7a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34395514-d7c3-4f6c-8892-361cecb941b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34395514-d7c3-4f6c-8892-361cecb941b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427659951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5936ab9-5aed-4281-a117-04ef9d3f1e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:22Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9353851-1ddf-417a-9d38-43e4412af9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9353851-1ddf-417a-9d38-43e4412af9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ef5549-9f5c-4d08-b049-b27e80e01c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ef5549-9f5c-4d08-b049-b27e80e01c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5936ab9-5aed-4281-a117-04ef9d3f1e43', 'volume_name': 'volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414dd9b-66b6-48db-af1c-e805dc3983f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9414dd9b-66b6-48db-af1c-e805dc3983f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e29593-7847-485a-a44b-ce0656a35133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Volume e5936ab9-5aed-4281-a117-04ef9d3f1e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43', 'volume_size': 1} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1427659951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5936ab9-5aed-4281-a117-04ef9d3f1e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:22Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Creating volume e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:21 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:22 devstack sudo[115199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 1073741824 Aug 26 00:26:22 devstack sudo[115199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:22 devstack sudo[115199]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 1073741824" returned: 0 in 0.631s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:22 devstack sudo[115206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 Aug 26 00:26:22 devstack sudo[115206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:22 devstack sudo[115206]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43" returned: 0 in 0.333s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e29593-7847-485a-a44b-ce0656a35133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87361d2-c199-40b5-b7b6-f5f8f14bbcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:23 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Volume volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 (e5936ab9-5aed-4281-a117-04ef9d3f1e43): created successfully Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d87361d2-c199-40b5-b7b6-f5f8f14bbcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (b84085ff-a33d-4665-a880-f46d042f7a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3efa4edf-be78-476d-ac1b-bb64ab591cef tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (2c8bc7d1-b3d4-451e-94cc-08d9b4359c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:23 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6e65aa-b986-4a7c-b6a4-f8f854ba69c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6e65aa-b986-4a7c-b6a4-f8f854ba69c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856894942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cb9251-6583-4804-8956-91d4753e6789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:24Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d82ca-7f5d-48c9-9d37-8ff8af80122b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d82ca-7f5d-48c9-9d37-8ff8af80122b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8584d9-4506-4b24-bb56-6cfa9f839979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8584d9-4506-4b24-bb56-6cfa9f839979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06cb9251-6583-4804-8956-91d4753e6789', 'volume_name': 'volume-06cb9251-6583-4804-8956-91d4753e6789', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3688a6-b89a-409d-a963-f032145338fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3688a6-b89a-409d-a963-f032145338fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7722078e-1bf9-407a-8925-f4ab1dfaf53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:24 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume 06cb9251-6583-4804-8956-91d4753e6789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06cb9251-6583-4804-8956-91d4753e6789', 'volume_size': 1} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-856894942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06cb9251-6583-4804-8956-91d4753e6789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:24Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume 06cb9251-6583-4804-8956-91d4753e6789 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:24 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:24 devstack sudo[115210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 1073741824 Aug 26 00:26:24 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:24 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 1073741824" returned: 0 in 0.571s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:24 devstack sudo[115216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 Aug 26 00:26:24 devstack sudo[115216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:24 devstack sudo[115216]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.772s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7722078e-1bf9-407a-8925-f4ab1dfaf53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06cb9251-6583-4804-8956-91d4753e6789', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b0c4d2-7f39-4678-981b-d2345087c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot 8d01f59d-7c48-44ff-955a-540448255d5b of volume e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-06cb9251-6583-4804-8956-91d4753e6789 (06cb9251-6583-4804-8956-91d4753e6789): created successfully Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b0c4d2-7f39-4678-981b-d2345087c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (2c8bc7d1-b3d4-451e-94cc-08d9b4359c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0401cff9-550e-47f6-b623-6453847d8bd3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:25 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0d31361e-5d13-4db7-8088-98fa2c6436ee tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:25 devstack sudo[115219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 Aug 26 00:26:25 devstack sudo[115219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:25 devstack sudo[115219]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43" returned: 0 in 0.436s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:25 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b 1G Aug 26 00:26:25 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:26 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b 1G" returned: 0 in 0.587s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:26 devstack sudo[115232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b Aug 26 00:26:26 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:26 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b" returned: 0 in 0.463s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:26 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b is being set with open permissions: ugo+rw Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:26 devstack sudo[115239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b Aug 26 00:26:26 devstack sudo[115239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (ec8bd81b-f682-4c1d-9028-4fc163c09c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ae2a87-7e3f-439a-b720-d931f46284d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ae2a87-7e3f-439a-b720-d931f46284d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-980382315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15378d7-40f2-47a8-9fb8-ac50259268b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:27Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a6868b-dcd1-49e6-be99-3f7a15c17b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a6868b-dcd1-49e6-be99-3f7a15c17b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebe4158-7930-462f-add2-c7d260ed7825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ebe4158-7930-462f-add2-c7d260ed7825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15378d7-40f2-47a8-9fb8-ac50259268b4', 'volume_name': 'volume-b15378d7-40f2-47a8-9fb8-ac50259268b4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c3ed7e-7f18-4932-9f44-5cf96ef4edf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c3ed7e-7f18-4932-9f44-5cf96ef4edf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731ef6d4-c8af-4e93-b043-ee79ee34282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume b15378d7-40f2-47a8-9fb8-ac50259268b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15378d7-40f2-47a8-9fb8-ac50259268b4', 'volume_size': 1} Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:26 devstack sudo[115239]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b" returned: 0 in 0.408s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:27 devstack sudo[115242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info Aug 26 00:26:27 devstack sudo[115242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=209,cinder:UPDATE=252,cinder:INSERT=68,cinder:DELETE=23 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:UPDATE=258,cinder:SELECT=186,cinder:DELETE=22,cinder:INSERT=74 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:26:27 devstack sudo[115242]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info" returned: 0 in 0.504s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:27 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info is being set with open permissions: ugo+rw Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (c5a848bb-b25b-4157-9205-5175d3cca2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:27 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c4fde4-146f-4628-9d5a-40372c2b2b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:27 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c4fde4-146f-4628-9d5a-40372c2b2b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573657314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:27Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea7826-fe76-48ff-a107-fc01920bfa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea7826-fe76-48ff-a107-fc01920bfa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47631c9d-257a-45a9-aa4f-172d1fe693d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47631c9d-257a-45a9-aa4f-172d1fe693d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7', 'volume_name': 'volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8442c74b-2b97-45c2-b6bf-c86084f09736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8442c74b-2b97-45c2-b6bf-c86084f09736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f16177-6e9c-4a65-a7bb-464d901b5a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:27 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7', 'volume_size': 1} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:27 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (d4f43440-e9ac-42e1-ac6c-fa72ed439d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be49b170-8643-4faa-9863-514e590c12e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be49b170-8643-4faa-9863-514e590c12e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005043757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:28Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31496027-dfe0-45c0-b766-bf79448e1b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31496027-dfe0-45c0-b766-bf79448e1b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1513f19-f320-45ce-a6e3-86342b8a44f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1513f19-f320-45ce-a6e3-86342b8a44f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9', 'volume_name': 'volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418f86d-fff5-46fc-8223-4d0b3e7da9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4418f86d-fff5-46fc-8223-4d0b3e7da9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329e8a9b-e1c3-4f94-8d19-362da55680e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume 7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9', 'volume_size': 1} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.info" returned: 0 in 0.570s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.377s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-980382315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15378d7-40f2-47a8-9fb8-ac50259268b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:27Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume b15378d7-40f2-47a8-9fb8-ac50259268b4 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:28 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:28 devstack sudo[115249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 1073741824 Aug 26 00:26:28 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e6287389-fa85-43ab-9488-563ceb792ac8 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-8d01f59d-7c48-44ff-955a-540448255d5b-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-8d01f59d-7c48-44ff-955a-540448255d5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (db376f42-8961-4596-a08f-dc14ba594cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f627aaa-0896-49c9-830e-7a7c77082d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f627aaa-0896-49c9-830e-7a7c77082d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542643455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1680682-2022-4b22-ad1f-71a95303edbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:29Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec381ce3-b8ff-4604-972a-0828b38f756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec381ce3-b8ff-4604-972a-0828b38f756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf3ac8e-4e36-4bec-83e4-86e18e28ae34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf3ac8e-4e36-4bec-83e4-86e18e28ae34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1680682-2022-4b22-ad1f-71a95303edbe', 'volume_name': 'volume-b1680682-2022-4b22-ad1f-71a95303edbe', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa07875-36cc-4162-ac5f-241e3efcf0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa07875-36cc-4162-ac5f-241e3efcf0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5494e-e73f-4019-986a-298884819520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume b1680682-2022-4b22-ad1f-71a95303edbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1680682-2022-4b22-ad1f-71a95303edbe', 'volume_size': 1} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" acquired by "delete_snapshot" :: waited 0.199s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-8d01f59d-7c48-44ff-955a-540448255d5b" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-8d01f59d-7c48-44ff-955a-540448255d5b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot 8d01f59d-7c48-44ff-955a-540448255d5b of volume e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[73350386-c36a-4cb1-9a1d-d1227c2da1f5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:29 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 1073741824" returned: 0 in 0.889s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:29 devstack sudo[115256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 Aug 26 00:26:29 devstack sudo[115256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:29 devstack sudo[115255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b Aug 26 00:26:29 devstack sudo[115255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (90fbf330-05c8-46b0-82e2-4374e6751133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927cb32-1f8b-4dce-b920-ef6c8586da40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack sudo[115256]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8927cb32-1f8b-4dce-b920-ef6c8586da40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445492999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0446e920-3d1b-444a-8345-619b5cf407b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:29Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack sudo[115255]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9b694b-330e-4c61-8c98-16cb2a85c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9b694b-330e-4c61-8c98-16cb2a85c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a7a25-f249-4849-a80e-c820a25a2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a7a25-f249-4849-a80e-c820a25a2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0446e920-3d1b-444a-8345-619b5cf407b2', 'volume_name': 'volume-0446e920-3d1b-444a-8345-619b5cf407b2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccab8ecb-4f12-44de-9e52-0927e40c10cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccab8ecb-4f12-44de-9e52-0927e40c10cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0526d2f-8955-4194-bd55-444853801428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume 0446e920-3d1b-444a-8345-619b5cf407b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0446e920-3d1b-444a-8345-619b5cf407b2', 'volume_size': 1} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b" returned: 0 in 0.711s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4" returned: 0 in 0.571s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.085s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573657314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:27Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:29 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c5f10c-1339-444e-968d-ccbae80801ae]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:29 devstack sudo[115267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 1073741824 Aug 26 00:26:29 devstack sudo[115267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731ef6d4-c8af-4e93-b043-ee79ee34282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15378d7-40f2-47a8-9fb8-ac50259268b4', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60ec42b-57f1-4569-b039-b9ac0e0a0344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 (b15378d7-40f2-47a8-9fb8-ac50259268b4): created successfully Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60ec42b-57f1-4569-b039-b9ac0e0a0344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (ec8bd81b-f682-4c1d-9028-4fc163c09c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0b20758f-2356-497f-bab6-66ad8aa25155 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:29 devstack sudo[115268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 Aug 26 00:26:29 devstack sudo[115268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:30 devstack sudo[115268]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43" returned: 0 in 0.589s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:30 devstack sudo[115278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b Aug 26 00:26:30 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:30 devstack sudo[115267]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 1073741824" returned: 0 in 0.711s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:30 devstack sudo[115281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 Aug 26 00:26:30 devstack sudo[115281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:30 devstack sudo[115281]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" returned: 0 in 0.322s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.778s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2005043757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:28Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume 7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:30 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f16177-6e9c-4a65-a7bb-464d901b5a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:30 devstack sudo[115288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 1073741824 Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e195b9-69f9-4377-a14b-cd6cd6c2cbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:30 devstack sudo[115288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:30 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b" returned: 0 in 0.571s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:30 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 (a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7): created successfully Aug 26 00:26:30 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3e195b9-69f9-4377-a14b-cd6cd6c2cbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (c5a848bb-b25b-4157-9205-5175d3cca2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:31 devstack sudo[115290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b Aug 26 00:26:31 devstack sudo[115290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e449a80b-f90a-4cfb-a2c6-37cbc2c522c9 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:31 devstack sudo[115290]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43.8d01f59d-7c48-44ff-955a-540448255d5b" returned: 0 in 0.456s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-8d01f59d-7c48-44ff-955a-540448255d5b" released by "_delete_snapshot" :: held 2.532s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" released by "delete_snapshot" :: held 2.574s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:31 devstack sudo[115288]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 1073741824" returned: 0 in 0.675s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:31 devstack sudo[115297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 Aug 26 00:26:31 devstack sudo[115297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Created reservations ['56eebaf4-3288-49e0-91af-c76fbe303f69', '295261d8-8328-4bd1-b4fa-998c4e047bf1', 'b02184e1-6438-422d-b719-cb855cb91019', '2b599b75-f2ff-41b7-83bd-4c9a354a0e2d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c7b5f357-ebea-4851-aff8-703ba84d58c9 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-8d01f59d-7c48-44ff-955a-540448255d5b-delete_snapshot" released by "delete_snapshot" :: held 3.086s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-e5936ab9-5aed-4281-a117-04ef9d3f1e43-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "cinder-e5936ab9-5aed-4281-a117-04ef9d3f1e43-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:32 devstack sudo[115297]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" returned: 0 in 0.422s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1542643455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1680682-2022-4b22-ad1f-71a95303edbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:29Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume b1680682-2022-4b22-ad1f-71a95303edbe {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:32 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec8f81-69e3-43fd-9aa4-aca61c8d6a31]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:32 devstack sudo[115300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe 1073741824 Aug 26 00:26:32 devstack sudo[115300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (329e8a9b-e1c3-4f94-8d19-362da55680e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ec1806-ff2b-49b2-9179-14123ce407ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:32 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 (7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9): created successfully Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ec1806-ff2b-49b2-9179-14123ce407ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (d4f43440-e9ac-42e1-ac6c-fa72ed439d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4d348931-0928-4fd7-8b13-67821d3453d3 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:32 devstack sudo[115302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 Aug 26 00:26:32 devstack sudo[115302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:32 devstack sudo[115302]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43" returned: 0 in 0.626s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:32 devstack sudo[115311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43 Aug 26 00:26:32 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:32 devstack sudo[115300]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe 1073741824" returned: 0 in 0.715s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:32 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe Aug 26 00:26:32 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:33 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-e5936ab9-5aed-4281-a117-04ef9d3f1e43" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-e5936ab9-5aed-4281-a117-04ef9d3f1e43" released by "delete_volume" :: held 1.140s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:33 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.486s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445492999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0446e920-3d1b-444a-8345-619b5cf407b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b77a9fcfb82440a49b94bb991127b57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:29Z,use_quota=True,user_id='956b5cd867d944f5afb0063976c7e37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Creating volume 0446e920-3d1b-444a-8345-619b5cf407b2 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:33 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc5494e-e73f-4019-986a-298884819520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1680682-2022-4b22-ad1f-71a95303edbe', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c812f-ee93-47f7-9004-37d13b22afe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:33 devstack sudo[115317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 1073741824 Aug 26 00:26:33 devstack sudo[115317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Created reservations ['84eab3ba-4085-4068-98b9-6e91f5f9ca17', 'a7a6e42b-fd50-47cd-8ff7-068e7f325eae', '0785d46b-a97d-4a8d-bbff-4cf0ef4046e2', 'ec63ffbb-88fa-4933-8050-04240561a2e8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:33 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-b1680682-2022-4b22-ad1f-71a95303edbe (b1680682-2022-4b22-ad1f-71a95303edbe): created successfully Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (213c812f-ee93-47f7-9004-37d13b22afe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (db376f42-8961-4596-a08f-dc14ba594cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-04df1342-cbe0-4330-990c-18e4d8183f19 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:33 devstack sudo[115319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:33 devstack sudo[115319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:33 devstack sudo[115319]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.295s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:26:33 devstack sudo[115317]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 1073741824" returned: 0 in 0.489s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d0f55544-dc55-4023-8bbb-7420fcae096c tempest-ProjectMemberTests-1845745940 None] Lock "cinder-e5936ab9-5aed-4281-a117-04ef9d3f1e43-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:33 devstack sudo[115328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 Aug 26 00:26:33 devstack sudo[115328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:34 devstack sudo[115328]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0526d2f-8955-4194-bd55-444853801428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0446e920-3d1b-444a-8345-619b5cf407b2', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c70efa-3eeb-4329-9118-717cf8341d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Volume volume-0446e920-3d1b-444a-8345-619b5cf407b2 (0446e920-3d1b-444a-8345-619b5cf407b2): created successfully Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c70efa-3eeb-4329-9118-717cf8341d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Flow 'volume_create_manager' (90fbf330-05c8-46b0-82e2-4374e6751133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:34 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a2d9210c-0ba5-4aaf-a8ce-46574ea45557 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created volume successfully. Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Flow 'volume_create_manager' (58b0460b-3100-4295-b25b-9c2e4f7db2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e0c0a9-03f4-4a21-9a35-4f34dc10df81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08e0c0a9-03f4-4a21-9a35-4f34dc10df81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1428028520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a1cf47-b900-40a4-952e-5c466013c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6384020e90f4150a4b962fae6db7acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:34Z,use_quota=True,user_id='02fe013de9af45cbb6296f1bcfd798ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57951f73-4a05-4213-b47e-85085710d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57951f73-4a05-4213-b47e-85085710d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d47bc-a017-4c4d-9136-74cf85b1d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4d47bc-a017-4c4d-9136-74cf85b1d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64a1cf47-b900-40a4-952e-5c466013c5a3', 'volume_name': 'volume-64a1cf47-b900-40a4-952e-5c466013c5a3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49d36ed-b47f-4f16-ad7c-aedd88b840cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f49d36ed-b47f-4f16-ad7c-aedd88b840cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670c3510-9901-4b5d-a5b7-dacceba8513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Volume 64a1cf47-b900-40a4-952e-5c466013c5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64a1cf47-b900-40a4-952e-5c466013c5a3', 'volume_size': 1} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1428028520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64a1cf47-b900-40a4-952e-5c466013c5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6384020e90f4150a4b962fae6db7acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:34Z,use_quota=True,user_id='02fe013de9af45cbb6296f1bcfd798ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Creating volume 64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:34 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:34 devstack sudo[115331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 1073741824 Aug 26 00:26:34 devstack sudo[115331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (9d904144-b4ea-4cf7-954f-624154009542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51247b4-103a-43fc-85a3-4da0aa5ef2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51247b4-103a-43fc-85a3-4da0aa5ef2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734848965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72787654-904f-4beb-a724-acd28a1ee2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:35Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76030849-2ea1-40da-a584-108e24e97a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76030849-2ea1-40da-a584-108e24e97a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack sudo[115331]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183d6b9e-8610-417f-9a08-23e3aa298af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (183d6b9e-8610-417f-9a08-23e3aa298af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72787654-904f-4beb-a724-acd28a1ee2f8', 'volume_name': 'volume-72787654-904f-4beb-a724-acd28a1ee2f8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28293b9d-1ddf-404d-8367-67b85eae4b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28293b9d-1ddf-404d-8367-67b85eae4b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c4342f-8e62-44c5-abc4-f8a584f628f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:34 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Volume 72787654-904f-4beb-a724-acd28a1ee2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72787654-904f-4beb-a724-acd28a1ee2f8', 'volume_size': 1} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 1073741824" returned: 0 in 0.524s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:34 devstack sudo[115336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:34 devstack sudo[115336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-0446e920-3d1b-444a-8345-619b5cf407b2-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-0446e920-3d1b-444a-8345-619b5cf407b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-0446e920-3d1b-444a-8345-619b5cf407b2" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-0446e920-3d1b-444a-8345-619b5cf407b2" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:35 devstack sudo[115336]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.284s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734848965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72787654-904f-4beb-a724-acd28a1ee2f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:35Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Creating volume 72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:35 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[975284f2-b9e8-4683-9c2c-7a5ce70d1064]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:35 devstack sudo[115339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 1073741824 Aug 26 00:26:35 devstack sudo[115339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670c3510-9901-4b5d-a5b7-dacceba8513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64a1cf47-b900-40a4-952e-5c466013c5a3', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0cd0fc-24e3-49bf-9c96-f4902d3990b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Volume volume-64a1cf47-b900-40a4-952e-5c466013c5a3 (64a1cf47-b900-40a4-952e-5c466013c5a3): created successfully Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0cd0fc-24e3-49bf-9c96-f4902d3990b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Flow 'volume_create_manager' (58b0460b-3100-4295-b25b-9c2e4f7db2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-80f719d5-e9b5-4c66-8613-437d57d561ec tempest-SnapshotDependencyTests-1196928025 None] Created volume successfully. Aug 26 00:26:35 devstack sudo[115340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 Aug 26 00:26:35 devstack sudo[115340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:35 devstack sudo[115340]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2" returned: 0 in 0.385s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:35 devstack sudo[115339]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 1073741824" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:35 devstack sudo[115350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2 Aug 26 00:26:35 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:35 devstack sudo[115352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 Aug 26 00:26:35 devstack sudo[115352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:35 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0446e920-3d1b-444a-8345-619b5cf407b2" returned: 0 in 0.281s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-0446e920-3d1b-444a-8345-619b5cf407b2" released by "delete_volume" :: held 0.738s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:35 devstack sudo[115352]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8" returned: 0 in 0.263s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c4342f-8e62-44c5-abc4-f8a584f628f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72787654-904f-4beb-a724-acd28a1ee2f8', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7cebd-e7e5-464f-af08-5c66d5deb774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:35 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Volume volume-72787654-904f-4beb-a724-acd28a1ee2f8 (72787654-904f-4beb-a724-acd28a1ee2f8): created successfully Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51d7cebd-e7e5-464f-af08-5c66d5deb774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (9d904144-b4ea-4cf7-954f-624154009542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1ec92579-74db-4452-ac01-3c47a0d9114a tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['a090f2cb-8cd9-407b-88e7-b1007a48ade1', 'f7f9e582-24ad-4fab-b04c-95f6778fde34', '3ef1d23f-b949-476d-95cc-9088113fe69c', 'ea92cc30-27f2-457d-b3fa-f3d92d45fa24'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:36 devstack sudo[115356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:36 devstack sudo[115356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-b1680682-2022-4b22-ad1f-71a95303edbe-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-b1680682-2022-4b22-ad1f-71a95303edbe-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-b1680682-2022-4b22-ad1f-71a95303edbe" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:36 devstack sudo[115356]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.278s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-b1680682-2022-4b22-ad1f-71a95303edbe" acquired by "delete_volume" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[86547a44-b688-4dd7-937a-c3b84552a8ea]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-e3985ee1-7ced-4499-aa31-da93f7588bac tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-0446e920-3d1b-444a-8345-619b5cf407b2-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:36 devstack sudo[115359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe Aug 26 00:26:36 devstack sudo[115359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:36 devstack sudo[115359]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe" returned: 0 in 0.465s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:36 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe Aug 26 00:26:36 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Creating offline snapshot 729c6a34-a8a0-4075-aaef-6c354f372315 of volume 64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5503b2d0-40d4-4e5b-8f03-6d34dbb4c161]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:37 devstack sudo[115366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:37 devstack sudo[115366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:37 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b1680682-2022-4b22-ad1f-71a95303edbe" returned: 0 in 0.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-b1680682-2022-4b22-ad1f-71a95303edbe" released by "delete_volume" :: held 0.815s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['f0a875e7-94a2-445d-b789-cb359a998ec4', '207da1f1-15a5-48d5-98f2-ef0e371085ec', '26d6c4e0-b66b-4320-9acc-de88d35dd694', '08532203-49e7-4c2e-a44f-729ce34479c8'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:37 devstack sudo[115372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:37 devstack sudo[115372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:37 devstack sudo[115366]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.390s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:37 devstack sudo[115374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 1G Aug 26 00:26:37 devstack sudo[115374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:37 devstack sudo[115372]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.254s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:37 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-cf0d2e4b-b4f6-409f-8d75-647f4f61259f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-b1680682-2022-4b22-ad1f-71a95303edbe-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1f7795-536b-4f42-ab16-e3bfec47da11]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:37 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 Aug 26 00:26:37 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:37 devstack sudo[115374]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 1G" returned: 0 in 0.497s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a1cf47-b900-40a4-952e-5c466013c5a3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:37 devstack sudo[115384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a1cf47-b900-40a4-952e-5c466013c5a3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:37 devstack sudo[115384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack sudo[115390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9 Aug 26 00:26:38 devstack sudo[115390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack sudo[115384]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64a1cf47-b900-40a4-952e-5c466013c5a3 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 is being set with open permissions: ugo+rw Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack sudo[115394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:38 devstack sudo[115394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack sudo[115390]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9" released by "delete_volume" :: held 0.721s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['a92ee4db-bb9e-4ad3-af7f-9c2018b8c3b8', '3bba327f-5427-4d87-9bae-8d5e7fe7d719', '40ab2448-74dd-4145-b161-86b547f90ec0', '8796f89f-6368-4cb9-bb02-4bce2f91c330'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:38 devstack sudo[115394]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.273s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:38 devstack sudo[115398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack sudo[115398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack sudo[115400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:38 devstack sudo[115400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ea5f59-1431-40d5-82d3-1701e65b2574]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack sudo[115400]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack sudo[115398]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.322s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info" returned: 0 in 0.356s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:38 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info is being set with open permissions: ugo+rw Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:38 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info Aug 26 00:26:38 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6519c100-8c10-403a-a297-d04de9d49751 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-7e0e7fa0-a342-4cd9-be9b-6dec163ee5c9-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:39 devstack sudo[115404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 Aug 26 00:26:39 devstack sudo[115404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:39 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.info" returned: 0 in 0.270s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.163s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot 317687dc-4a9b-411c-a832-55268ab2fc1d of volume 72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3b5ac253-a024-45cb-9961-1e17947cde40 tempest-SnapshotDependencyTests-1196928025 None] Create snapshot completed successfully Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0734537b-58b4-4188-88a6-b4a12e7d4731]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:39 devstack sudo[115404]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" returned: 0 in 0.369s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:39 devstack sudo[115413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7 Aug 26 00:26:39 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:39 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 Aug 26 00:26:39 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:39 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7" released by "delete_volume" :: held 0.652s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['7ebd31bd-ac92-4f70-93a9-2d866da7edca', '297264bf-d72b-4e1f-9025-1f10a1094ee0', 'b7a82322-e73e-42a8-8a54-7258d57335ca', 'ff033f91-9f9c-44cd-b709-4c9e29cce012'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:39 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:39 devstack sudo[115420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d 1G Aug 26 00:26:39 devstack sudo[115420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:39 devstack sudo[115422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:39 devstack sudo[115422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:39 devstack sudo[115422]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.301s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:39 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-d5cc56ba-55da-49ee-81b6-24d1bb9d794f tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-a07e5c2f-10f6-4dfe-b520-c6bd3dd7f2c7-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-b15378d7-40f2-47a8-9fb8-ac50259268b4-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-b15378d7-40f2-47a8-9fb8-ac50259268b4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-b15378d7-40f2-47a8-9fb8-ac50259268b4" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-b15378d7-40f2-47a8-9fb8-ac50259268b4" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:40 devstack sudo[115420]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d 1G" returned: 0 in 0.551s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72787654-904f-4beb-a724-acd28a1ee2f8 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8937c86-0c93-4efe-a604-a28525e1fae4]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:40 devstack sudo[115429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72787654-904f-4beb-a724-acd28a1ee2f8 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d Aug 26 00:26:40 devstack sudo[115429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:40 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 Aug 26 00:26:40 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:40 devstack sudo[115429]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72787654-904f-4beb-a724-acd28a1ee2f8 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d" returned: 0 in 0.389s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:40 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d is being set with open permissions: ugo+rw Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:40 devstack sudo[115440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d Aug 26 00:26:40 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:40 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:40 devstack sudo[115442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4 Aug 26 00:26:40 devstack sudo[115442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:40 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d" returned: 0 in 0.309s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:40 devstack sudo[115445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info Aug 26 00:26:40 devstack sudo[115445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:40 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Flow 'volume_create_manager' (df3c6ea7-14a8-418e-ae33-c1cad79d0d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:40 devstack sudo[115442]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de8b44-deeb-40bd-84aa-92582fdec3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-b15378d7-40f2-47a8-9fb8-ac50259268b4" returned: 0 in 0.395s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70de8b44-deeb-40bd-84aa-92582fdec3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd81369-370d-46e3-b37c-96472904036a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6384020e90f4150a4b962fae6db7acf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=729c6a34-a8a0-4075-aaef-6c354f372315,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:41Z,use_quota=True,user_id='02fe013de9af45cbb6296f1bcfd798ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2504776-ceac-4170-88ed-df7a2515412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2504776-ceac-4170-88ed-df7a2515412c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f35f28-903f-4830-b451-8d8697e27beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f35f28-903f-4830-b451-8d8697e27beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fcd81369-370d-46e3-b37c-96472904036a', 'volume_name': 'volume-fcd81369-370d-46e3-b37c-96472904036a', 'volume_size': 1, 'snapshot_id': '729c6a34-a8a0-4075-aaef-6c354f372315'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a39f44c-c9e9-4357-8720-d3c9a41afaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a39f44c-c9e9-4357-8720-d3c9a41afaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01e4ee3-6079-49f6-80fc-027e25a62c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:41 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Volume fcd81369-370d-46e3-b37c-96472904036a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fcd81369-370d-46e3-b37c-96472904036a', 'volume_size': 1, 'snapshot_id': '729c6a34-a8a0-4075-aaef-6c354f372315'} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-b15378d7-40f2-47a8-9fb8-ac50259268b4" released by "delete_volume" :: held 0.938s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['045b44ae-9f99-47e7-a6bb-205e9af6b151', '1f1e1993-b537-45e9-b504-fe02e9407083', 'f00db9df-f794-4d19-addf-3afa2428eaeb', '8515e300-8c2c-4f4e-8801-57d08bcad41c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:41 devstack sudo[115445]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:41 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info is being set with open permissions: ugo+rw Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:41 devstack sudo[115449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info Aug 26 00:26:41 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:41 devstack sudo[115451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:41 devstack sudo[115451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:41 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.info" returned: 0 in 0.291s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.485s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315-fcd81369-370d-46e3-b37c-96472904036a" by "_create_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315-fcd81369-370d-46e3-b37c-96472904036a" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Creating volume fcd81369-370d-46e3-b37c-96472904036a from snapshot 729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" by "_copy_volume_from_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f1acf2ae-a0d1-4ad4-a6cf-2b1cc537735c tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:26:41 devstack sudo[115451]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.316s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] snapshot: 729c6a34-a8a0-4075-aaef-6c354f372315, volume: fcd81369-370d-46e3-b37c-96472904036a, {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 00:26:41 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa14ba93-bd2a-4fd3-9f82-cbcc70e3e52f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:41 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-63c728ff-1186-4f09-8ed2-76eefe2ae4dc tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-b15378d7-40f2-47a8-9fb8-ac50259268b4-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:41 devstack sudo[115455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:41 devstack sudo[115455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:42 devstack sudo[115455]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a1cf47-b900-40a4-952e-5c466013c5a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0894a39e-08a3-4899-89dd-519d4ccce319]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:42 devstack sudo[115460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:42 devstack sudo[115460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-317687dc-4a9b-411c-a832-55268ab2fc1d-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-317687dc-4a9b-411c-a832-55268ab2fc1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-317687dc-4a9b-411c-a832-55268ab2fc1d" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-06cb9251-6583-4804-8956-91d4753e6789-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-317687dc-4a9b-411c-a832-55268ab2fc1d" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot 317687dc-4a9b-411c-a832-55268ab2fc1d of volume 72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-06cb9251-6583-4804-8956-91d4753e6789-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfddcea2-c263-4fe9-b3a9-ef3e7f04c018]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "cinder-quobyte-06cb9251-6583-4804-8956-91d4753e6789" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:42 devstack sudo[115460]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.467s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Creating direct copy from snapshot {{(pid=94433) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.utils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Path /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a not found in is_blk_device check {{(pid=94433) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-06cb9251-6583-4804-8956-91d4753e6789" acquired by "delete_volume" :: waited 0.043s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:42 devstack sudo[115466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a Aug 26 00:26:42 devstack sudo[115466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63425dd-3f11-48d9-bb36-e610ff0f32af]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:42 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d Aug 26 00:26:42 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:42 devstack sudo[115469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 Aug 26 00:26:42 devstack sudo[115469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:42 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d" returned: 0 in 0.437s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72787654-904f-4beb-a724-acd28a1ee2f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[effea6ab-4521-483a-938f-aefd537c57a6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:42 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:43 devstack sudo[115478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 Aug 26 00:26:43 devstack sudo[115469]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:43 devstack sudo[115478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789" returned: 0 in 0.450s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:43 devstack sudo[115483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789 Aug 26 00:26:43 devstack sudo[115483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:43 devstack sudo[115483]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-06cb9251-6583-4804-8956-91d4753e6789" returned: 0 in 0.523s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-quobyte-06cb9251-6583-4804-8956-91d4753e6789" released by "delete_volume" :: held 1.038s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:43 devstack sudo[115478]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8" returned: 0 in 0.737s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:43 devstack sudo[115495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d Aug 26 00:26:43 devstack sudo[115495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:43 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Created reservations ['4755f522-e954-4963-98f5-0ddc57ad331d', '7bd2a441-a894-418c-8ef9-70f1ec6ea9e0', '593f937b-87c8-4b1f-aa53-341dd6fb9ec8', 'af61b894-fc03-4e77-ad17-10a616e1c7e9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:44 devstack sudo[115497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:44 devstack sudo[115497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:44 devstack sudo[115497]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.641s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:44 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Deleted volume successfully. Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-42dc6776-bc54-44e7-8aca-004876585263 tempest-CreateVolumesFromSourceVolumeTest-1682401308 None] Lock "cinder-06cb9251-6583-4804-8956-91d4753e6789-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:44 devstack sudo[115495]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d" returned: 0 in 1.095s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:44 devstack sudo[115505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d Aug 26 00:26:44 devstack sudo[115505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:45 devstack sudo[115505]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8.317687dc-4a9b-411c-a832-55268ab2fc1d" returned: 0 in 0.716s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-317687dc-4a9b-411c-a832-55268ab2fc1d" released by "_delete_snapshot" :: held 3.154s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" released by "delete_snapshot" :: held 3.210s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:45 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Created reservations ['395fa771-3b3e-4275-9a10-e3f703f520d9', '4d214635-60a7-4f26-8f12-09ac7be1bee1', 'fc5027db-fda1-4ec4-955d-ab9d28b0ec31', 'ddfdb6f3-af9e-442f-ab22-b5cd289594ff'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:26:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ef78b2fe-a391-4569-8c67-0d39686acc67 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-317687dc-4a9b-411c-a832-55268ab2fc1d-delete_snapshot" released by "delete_snapshot" :: held 3.562s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:46 devstack sudo[115508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:46 devstack sudo[115508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-72787654-904f-4beb-a724-acd28a1ee2f8-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-72787654-904f-4beb-a724-acd28a1ee2f8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" acquired by "delete_volume" :: waited 0.067s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:47 devstack sudo[115508]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.739s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e01f46-d932-4aeb-93e5-6b0ae811b318]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:47 devstack sudo[115511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 Aug 26 00:26:47 devstack sudo[115511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:48 devstack sudo[115511]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8" returned: 0 in 1.055s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:48 devstack sudo[115517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8 Aug 26 00:26:48 devstack sudo[115517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:48 devstack sudo[115466]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a" returned: 0 in 6.296s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG cinder.image.image_utils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Image conversion details: src /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a {{(pid=94433) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 00:26:48 devstack cinder-volume[94433]: INFO cinder.image.image_utils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Converted 1024.00 MB image at 162.60 MB/s Aug 26 00:26:48 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a is being set with open permissions: ugo+rw Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:48 devstack sudo[115517]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-72787654-904f-4beb-a724-acd28a1ee2f8" returned: 0 in 0.466s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:48 devstack sudo[115520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a Aug 26 00:26:48 devstack sudo[115520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-72787654-904f-4beb-a724-acd28a1ee2f8" released by "delete_volume" :: held 1.718s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Created reservations ['9a017bf2-b1cc-45ed-9ecc-6227b2d1b4e1', '113dffca-cc26-4cce-9562-417ac189d04a', '7cba911b-1e34-4b1e-98cb-68db9a50e2af', '5e755ae0-0650-4d28-a5db-d530b5438e3d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:49 devstack sudo[115522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:49 devstack sudo[115522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:49 devstack sudo[115520]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a" returned: 0 in 0.341s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" released by "_copy_volume_from_snapshot" :: held 7.579s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315-fcd81369-370d-46e3-b37c-96472904036a" released by "_create_volume_from_snapshot" :: held 7.681s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.726s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01e4ee3-6079-49f6-80fc-027e25a62c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd81369-370d-46e3-b37c-96472904036a', 'volume_size': 1, 'snapshot_id': '729c6a34-a8a0-4075-aaef-6c354f372315'}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750e7cc-1e07-4fcf-b8b1-fbdf94b1308a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:49 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Volume volume-fcd81369-370d-46e3-b37c-96472904036a (fcd81369-370d-46e3-b37c-96472904036a): created successfully Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750e7cc-1e07-4fcf-b8b1-fbdf94b1308a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Flow 'volume_create_manager' (df3c6ea7-14a8-418e-ae33-c1cad79d0d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5cfd251b-670f-48eb-a5d6-f6b6d22508ec tempest-SnapshotDependencyTests-1196928025 None] Created volume successfully. Aug 26 00:26:49 devstack sudo[115522]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:26:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6ed0c455-3740-4886-a951-87ed93809358 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-72787654-904f-4beb-a724-acd28a1ee2f8-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-729c6a34-a8a0-4075-aaef-6c354f372315-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-729c6a34-a8a0-4075-aaef-6c354f372315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Deleting offline snapshot 729c6a34-a8a0-4075-aaef-6c354f372315 of volume 64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] snapshot_file for this snap is: volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2d82e8-7fa5-47c8-b36f-b454af717330]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (67b84228-5884-4fe3-be3c-13d57af9c6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3517e7be-cb35-452c-818b-6731cb83baf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3517e7be-cb35-452c-818b-6731cb83baf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049442580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1566191b-ab77-4ae4-bac8-c5f489db0e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:50Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d910e3fe-1ce1-4805-aad6-dc93cf015808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d910e3fe-1ce1-4805-aad6-dc93cf015808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afac5d28-c2c8-47da-95ce-70328be7c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afac5d28-c2c8-47da-95ce-70328be7c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1566191b-ab77-4ae4-bac8-c5f489db0e3e', 'volume_name': 'volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c114cf17-1a97-493b-84f9-4d98b899005b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c114cf17-1a97-493b-84f9-4d98b899005b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:50 devstack sudo[115526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:50 devstack sudo[115526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d5448-e1ca-4a03-a23c-036cb8c3ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:50 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Volume 1566191b-ab77-4ae4-bac8-c5f489db0e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e', 'volume_size': 1} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2049442580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1566191b-ab77-4ae4-bac8-c5f489db0e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:50Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Creating volume 1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:50 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:50 devstack sudo[115528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e 1073741824 Aug 26 00:26:50 devstack sudo[115528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:50 devstack sudo[115526]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.465s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64a1cf47-b900-40a4-952e-5c466013c5a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2844a5-bfc3-4f7f-857e-6b354b49dfaf]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:50 devstack sudo[115536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:50 devstack sudo[115536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:50 devstack sudo[115528]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e 1073741824" returned: 0 in 0.560s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:51 devstack sudo[115539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e Aug 26 00:26:51 devstack sudo[115539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:51 devstack sudo[115539]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e" returned: 0 in 0.353s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d5448-e1ca-4a03-a23c-036cb8c3ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cddf84d-390f-45b5-8e4e-9ee61db76415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:51 devstack sudo[115536]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.651s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:51 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Volume volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e (1566191b-ab77-4ae4-bac8-c5f489db0e3e): created successfully Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cddf84d-390f-45b5-8e4e-9ee61db76415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (67b84228-5884-4fe3-be3c-13d57af9c6ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:51 devstack sudo[115545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:51 devstack sudo[115545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-02d704c7-4fec-4fac-b704-213859d9faf5 tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:26:51 devstack sudo[115545]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.381s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:51 devstack sudo[115551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315 Aug 26 00:26:51 devstack sudo[115551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:52 devstack sudo[115551]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3.729c6a34-a8a0-4075-aaef-6c354f372315" returned: 0 in 0.308s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-729c6a34-a8a0-4075-aaef-6c354f372315" released by "_delete_snapshot" :: held 1.950s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" released by "delete_snapshot" :: held 1.992s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (6496d11f-5c82-426d-bb1d-964fff359ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2ccdd-1a81-41f9-b0f5-bd5b7972664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a2ccdd-1a81-41f9-b0f5-bd5b7972664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452962640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f2dc1e-5817-4824-9efd-2ef15ffa85db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:52Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2ad733-6a6b-4b15-a8e5-efc2fa17c7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2ad733-6a6b-4b15-a8e5-efc2fa17c7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e67a47-a785-4061-ad60-817ca1181219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e67a47-a785-4061-ad60-817ca1181219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f2dc1e-5817-4824-9efd-2ef15ffa85db', 'volume_name': 'volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ea00f-aa2e-4a90-b3ba-12bce6a7efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (304ea00f-aa2e-4a90-b3ba-12bce6a7efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337f9a69-3111-494b-9f72-1ca0ae9384dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Volume 70f2dc1e-5817-4824-9efd-2ef15ffa85db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db', 'volume_size': 1} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452962640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f2dc1e-5817-4824-9efd-2ef15ffa85db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:26:52Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Creating volume 70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:26:52 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:52 devstack sudo[115554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db 1073741824 Aug 26 00:26:52 devstack sudo[115554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Created reservations ['a01ab328-67de-4fb7-91c8-4e5b90ccd9f9', '4d285e20-9c25-4dc3-91ef-a88f9b909871', 'ac6f6d7d-fe3e-41d8-9205-0ef448f94c0e', 'f359fb6a-5f14-448e-8a07-dd57b3ba0256'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:52 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Delete snapshot completed successfully. Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-146c267a-dc88-48e3-891a-018dbc236ff2 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-729c6a34-a8a0-4075-aaef-6c354f372315-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:52 devstack sudo[115554]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db 1073741824" returned: 0 in 0.492s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:52 devstack sudo[115560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db Aug 26 00:26:52 devstack sudo[115560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:53 devstack sudo[115560]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db" returned: 0 in 0.266s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.680s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot 03dd50ec-153a-4b1f-bdb2-86b82377220e of volume 1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (337f9a69-3111-494b-9f72-1ca0ae9384dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2515d733-9db0-4329-a87e-7ca1ddd27cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbd1fbb-ed79-4bf3-8810-897a4ea1daeb]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Volume volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db (70f2dc1e-5817-4824-9efd-2ef15ffa85db): created successfully Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2515d733-9db0-4329-a87e-7ca1ddd27cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (6496d11f-5c82-426d-bb1d-964fff359ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:26:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-18253e83-bf44-497a-a3dc-c10542bafbf2 tempest-ProjectReaderTests-995475930 None] Created volume successfully. Aug 26 00:26:53 devstack sudo[115563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e Aug 26 00:26:53 devstack sudo[115563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-64a1cf47-b900-40a4-952e-5c466013c5a3-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-64a1cf47-b900-40a4-952e-5c466013c5a3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0086341f-57be-4a60-a184-c160956c3781]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:53 devstack sudo[115563]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e" returned: 0 in 0.450s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:53 devstack sudo[115567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:53 devstack sudo[115567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:53 devstack sudo[115569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e 1G Aug 26 00:26:53 devstack sudo[115569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:53 devstack sudo[115567]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:53 devstack sudo[115578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3 Aug 26 00:26:53 devstack sudo[115578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:54 devstack sudo[115569]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e 1G" returned: 0 in 0.454s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:54 devstack sudo[115581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e Aug 26 00:26:54 devstack sudo[115581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:54 devstack sudo[115578]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-64a1cf47-b900-40a4-952e-5c466013c5a3" returned: 0 in 0.286s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-64a1cf47-b900-40a4-952e-5c466013c5a3" released by "delete_volume" :: held 0.768s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Created reservations ['8fb9f1e0-e9a9-46ad-87c6-f46716eeeb0e', 'a460ac74-9062-4ab5-945f-e5ba68b7fb83', 'b204d2cf-e120-44cd-9498-abe2a1437fb4', '9c9fdb73-619a-411e-80ae-204439703a00'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:54 devstack sudo[115587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:54 devstack sudo[115587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:54 devstack sudo[115581]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e" returned: 0 in 0.387s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:54 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e is being set with open permissions: ugo+rw Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:54 devstack sudo[115590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e Aug 26 00:26:54 devstack sudo[115590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-fcd81369-370d-46e3-b37c-96472904036a-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-fcd81369-370d-46e3-b37c-96472904036a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29bff5e-f7ca-45d0-a59d-e2b10c3be9a6]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:54 devstack sudo[115587]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Deleted volume successfully. Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-de13dcdb-5dd1-4ad7-870f-6faefc4ed6f3 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-64a1cf47-b900-40a4-952e-5c466013c5a3-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:54 devstack sudo[115590]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:54 devstack sudo[115593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a Aug 26 00:26:54 devstack sudo[115593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:54 devstack sudo[115596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info Aug 26 00:26:54 devstack sudo[115596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:55 devstack sudo[115593]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:55 devstack sudo[115596]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info" returned: 0 in 0.309s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:55 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info is being set with open permissions: ugo+rw Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:55 devstack sudo[115602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a Aug 26 00:26:55 devstack sudo[115602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:55 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info Aug 26 00:26:55 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:55 devstack sudo[115602]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-fcd81369-370d-46e3-b37c-96472904036a" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-quobyte-fcd81369-370d-46e3-b37c-96472904036a" released by "delete_volume" :: held 0.740s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:55 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.info" returned: 0 in 0.280s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.924s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Creating offline snapshot 7d4dfc24-d509-4230-a08d-ae9f26637e63 of volume 70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:26:55 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6d30ec77-a6d4-4ddf-b4e9-8ef453a71da0 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[687d4f12-2454-4cd3-b828-d230efa2fd3e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Created reservations ['cd76818f-383c-4578-a2cb-5fb9c81de0af', '1431a0e5-2655-4a57-b47d-39429db6f4c7', 'a4ce4c3f-2186-4fb9-8496-926a807374da', 'b02e81ba-74f0-4a35-8c59-1c135c993d7c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:55 devstack sudo[115608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db Aug 26 00:26:55 devstack sudo[115608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:55 devstack sudo[115610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:26:55 devstack sudo[115610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:55 devstack sudo[115608]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db" returned: 0 in 0.436s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:55 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:56 devstack sudo[115610]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:56 devstack sudo[115618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 1G Aug 26 00:26:56 devstack sudo[115618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.370s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:26:56 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Deleted volume successfully. Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6c334da7-2ba6-4a70-8c2f-2a918b6b49f4 tempest-SnapshotDependencyTests-1196928025 None] Lock "cinder-fcd81369-370d-46e3-b37c-96472904036a-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:56 devstack sudo[115618]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 1G" returned: 0 in 0.493s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:56 devstack sudo[115624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 Aug 26 00:26:56 devstack sudo[115624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-03dd50ec-153a-4b1f-bdb2-86b82377220e-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-03dd50ec-153a-4b1f-bdb2-86b82377220e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-03dd50ec-153a-4b1f-bdb2-86b82377220e" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-03dd50ec-153a-4b1f-bdb2-86b82377220e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot 03dd50ec-153a-4b1f-bdb2-86b82377220e of volume 1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d36b22d-5398-4ccd-a968-581471863032]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:56 devstack sudo[115624]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63" returned: 0 in 0.449s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:56 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 is being set with open permissions: ugo+rw Aug 26 00:26:56 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:56 devstack sudo[115630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 Aug 26 00:26:56 devstack sudo[115630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e Aug 26 00:26:57 devstack sudo[115629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115630]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63" returned: 0 in 0.307s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:57 devstack sudo[115636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info Aug 26 00:26:57 devstack sudo[115636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115629]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e" returned: 0 in 0.490s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a63bd-4934-4882-b767-a7a61389fc03]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:57 devstack sudo[115640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e Aug 26 00:26:57 devstack sudo[115640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115636]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info" returned: 0 in 0.293s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:57 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info is being set with open permissions: ugo+rw Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:57 devstack sudo[115643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info Aug 26 00:26:57 devstack sudo[115643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115640]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e" returned: 0 in 0.484s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:57 devstack sudo[115649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e Aug 26 00:26:57 devstack sudo[115649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:57 devstack sudo[115643]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.info" returned: 0 in 0.376s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:57 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:26:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6110bfea-711c-4a98-9455-b8587c2d50f1 tempest-ProjectReaderTests-995475930 None] Create snapshot completed successfully Aug 26 00:26:58 devstack sudo[115649]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:58 devstack sudo[115657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e Aug 26 00:26:58 devstack sudo[115657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:58 devstack sudo[115657]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e.03dd50ec-153a-4b1f-bdb2-86b82377220e" returned: 0 in 0.281s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-03dd50ec-153a-4b1f-bdb2-86b82377220e" released by "_delete_snapshot" :: held 1.782s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" released by "delete_snapshot" :: held 1.805s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Created reservations ['e4b928f6-27c9-460d-9750-a681e34a2c87', '2cc18d12-23cf-4ec6-86e5-9a5c0b5c2592', '669d661a-cf3d-49a7-8f25-2f8ce1c527f8', 'd24e5c3a-cfb8-46db-8177-b4c7e4b04fe9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:26:58 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c855173b-0619-4e05-873b-51274e5b23f6 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-03dd50ec-153a-4b1f-bdb2-86b82377220e-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-1566191b-ab77-4ae4-bac8-c5f489db0e3e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:58 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "cinder-1566191b-ab77-4ae4-bac8-c5f489db0e3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" acquired by "delete_volume" :: waited 0.033s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-7d4dfc24-d509-4230-a08d-ae9f26637e63-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df80126-0ba2-4c46-8129-b1b8d1f247f0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-7d4dfc24-d509-4230-a08d-ae9f26637e63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-7d4dfc24-d509-4230-a08d-ae9f26637e63" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-7d4dfc24-d509-4230-a08d-ae9f26637e63" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Deleting offline snapshot 7d4dfc24-d509-4230-a08d-ae9f26637e63 of volume 70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] snapshot_file for this snap is: volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c9f1a2-aea8-4aa4-8bc5-ea266ca3de7f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:59 devstack sudo[115660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e Aug 26 00:26:59 devstack sudo[115660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:59 devstack sudo[115661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 Aug 26 00:26:59 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:59 devstack sudo[115660]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e" returned: 0 in 0.396s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:59 devstack sudo[115667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e Aug 26 00:26:59 devstack sudo[115667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:59 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[73acec00-d6f6-47ed-b469-4aa49e7bfac0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:26:59 devstack sudo[115667]: pam_unix(sudo:session): session closed for user root Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1566191b-ab77-4ae4-bac8-c5f489db0e3e" returned: 0 in 0.285s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:26:59 devstack sudo[115672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db Aug 26 00:26:59 devstack sudo[115672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1566191b-ab77-4ae4-bac8-c5f489db0e3e" released by "delete_volume" :: held 0.823s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:26:59 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Created reservations ['8cb76cb6-ac4d-460e-81ee-6abbcd6489d0', '775c933f-13af-4a0d-a360-b1d2174fa418', 'd4f31d60-786f-4080-8638-b02c31590915', '22d086a0-09d6-4097-b9d9-4ca58271af6d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:00 devstack sudo[115675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:00 devstack sudo[115675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:00 devstack sudo[115672]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db" returned: 0 in 0.520s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:00 devstack sudo[115680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 Aug 26 00:27:00 devstack sudo[115680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:00 devstack sudo[115675]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.468s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:00 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f209c1e1-36bd-4734-b5c4-16b950a93aac tempest-ProjectMemberTests-1845745940 None] Lock "cinder-1566191b-ab77-4ae4-bac8-c5f489db0e3e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:00 devstack sudo[115680]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (05b2529b-fd25-4b04-bef1-8235608ec846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a623cf3-6bf3-49ac-aaee-448e05f584e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63" returned: 0 in 0.665s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:00 devstack sudo[115686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63 Aug 26 00:27:00 devstack sudo[115686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a623cf3-6bf3-49ac-aaee-448e05f584e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232158965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1658b9be-68c1-4cfc-99b7-2724cd340778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:01Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01273c1-c4ab-490b-a3f0-09da4e8938ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e01273c1-c4ab-490b-a3f0-09da4e8938ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bd596c-d3c6-455d-8667-9b5dbb4de3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bd596c-d3c6-455d-8667-9b5dbb4de3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1658b9be-68c1-4cfc-99b7-2724cd340778', 'volume_name': 'volume-1658b9be-68c1-4cfc-99b7-2724cd340778', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78c084d-a10f-49dc-b431-762be8394e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78c084d-a10f-49dc-b431-762be8394e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:00 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c4ad43-fee0-4bbe-ba14-5f2b1ad138c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Volume 1658b9be-68c1-4cfc-99b7-2724cd340778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1658b9be-68c1-4cfc-99b7-2724cd340778', 'volume_size': 1} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232158965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1658b9be-68c1-4cfc-99b7-2724cd340778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:01Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Creating volume 1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:01 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:01 devstack sudo[115688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 1073741824 Aug 26 00:27:01 devstack sudo[115688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:01 devstack sudo[115686]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db.7d4dfc24-d509-4230-a08d-ae9f26637e63" returned: 0 in 0.337s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-7d4dfc24-d509-4230-a08d-ae9f26637e63" released by "_delete_snapshot" :: held 2.067s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" released by "delete_snapshot" :: held 2.099s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Created reservations ['0c4f6edb-b051-4082-9eff-a6711a984eac', '28c9985d-6b78-469e-a0c5-928b0be6ce77', '83c4c3be-1f30-48d2-833f-4ccb9601ad76', '092460b5-903c-4149-8344-200645c4999a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Delete snapshot completed successfully. Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f9242fb8-f4e0-43d8-be84-3b3e7d58f0aa tempest-ProjectReaderTests-995475930 None] Lock "cinder-7d4dfc24-d509-4230-a08d-ae9f26637e63-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:01 devstack sudo[115688]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 1073741824" returned: 0 in 0.571s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:01 devstack sudo[115695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 Aug 26 00:27:01 devstack sudo[115695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:01 devstack sudo[115695]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778" returned: 0 in 0.279s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c4ad43-fee0-4bbe-ba14-5f2b1ad138c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1658b9be-68c1-4cfc-99b7-2724cd340778', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8f97ab-0166-4834-86ee-a1cc5f547a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:01 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Volume volume-1658b9be-68c1-4cfc-99b7-2724cd340778 (1658b9be-68c1-4cfc-99b7-2724cd340778): created successfully Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a8f97ab-0166-4834-86ee-a1cc5f547a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:01 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (05b2529b-fd25-4b04-bef1-8235608ec846) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:01 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-4a50cae1-e88a-463e-b535-4f782b16ed14 tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-70f2dc1e-5817-4824-9efd-2ef15ffa85db-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "cinder-70f2dc1e-5817-4824-9efd-2ef15ffa85db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239c30f-5066-4f03-9a08-c2b9d9140a10]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:02 devstack sudo[115698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db Aug 26 00:27:02 devstack sudo[115698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:02 devstack sudo[115698]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db" returned: 0 in 0.428s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:02 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:02 devstack sudo[115703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db Aug 26 00:27:02 devstack sudo[115703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 of volume 1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[f736e17a-5db2-4a82-8c68-bcc97f2e01f5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:03 devstack sudo[115703]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-70f2dc1e-5817-4824-9efd-2ef15ffa85db" returned: 0 in 0.355s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-70f2dc1e-5817-4824-9efd-2ef15ffa85db" released by "delete_volume" :: held 0.847s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:03 devstack sudo[115740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 Aug 26 00:27:03 devstack sudo[115740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Created reservations ['db83ebf8-a380-416c-bb08-064028c3e225', '6b9cce38-7ca0-4369-b8a0-157d3f9a2e3f', '58b0bd0f-8e97-4c39-a2aa-09fe86b4ae68', 'eaf45fbb-f809-4f23-a982-7363579a4476'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:03 devstack sudo[115743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:03 devstack sudo[115743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:03 devstack sudo[115740]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778" returned: 0 in 0.584s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:03 devstack sudo[115750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 1G Aug 26 00:27:03 devstack sudo[115750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:03 devstack sudo[115743]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:03 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Deleted volume successfully. Aug 26 00:27:03 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-933df4b0-5ea7-4009-9e60-698bb344c0dc tempest-ProjectReaderTests-995475930 None] Lock "cinder-70f2dc1e-5817-4824-9efd-2ef15ffa85db-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (44613d5e-606f-47dd-bf02-e4f18991acd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127e4ca2-4f10-4a86-868c-b6e0f565f2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (127e4ca2-4f10-4a86-868c-b6e0f565f2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128890909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7a5892-7935-46e6-ade8-2179fe84edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:04Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92e231f-45ea-436d-a845-5ced7a6ccd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92e231f-45ea-436d-a845-5ced7a6ccd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62030db-6c99-4343-9b52-b0849042ae60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62030db-6c99-4343-9b52-b0849042ae60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7a5892-7935-46e6-ade8-2179fe84edd7', 'volume_name': 'volume-ba7a5892-7935-46e6-ade8-2179fe84edd7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c17534-4846-4cfc-bf98-93799c579c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c17534-4846-4cfc-bf98-93799c579c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccd6c9f-259a-4ccb-87b1-63ccb502a981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:04 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Volume ba7a5892-7935-46e6-ade8-2179fe84edd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7a5892-7935-46e6-ade8-2179fe84edd7', 'volume_size': 1} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:04 devstack sudo[115750]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 1G" returned: 0 in 0.554s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1658b9be-68c1-4cfc-99b7-2724cd340778 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:04 devstack sudo[115758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1658b9be-68c1-4cfc-99b7-2724cd340778 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 Aug 26 00:27:04 devstack sudo[115758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:04 devstack sudo[115758]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1658b9be-68c1-4cfc-99b7-2724cd340778 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" returned: 0 in 0.298s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:04 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 is being set with open permissions: ugo+rw Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:04 devstack sudo[115763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 Aug 26 00:27:04 devstack sudo[115763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:04 devstack sudo[115763]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:04 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:04 devstack sudo[115766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info Aug 26 00:27:04 devstack sudo[115766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:05 devstack sudo[115766]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:05 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info is being set with open permissions: ugo+rw Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:05 devstack sudo[115769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info Aug 26 00:27:05 devstack sudo[115769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:05 devstack sudo[115769]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.info" returned: 0 in 0.240s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.188s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1128890909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7a5892-7935-46e6-ade8-2179fe84edd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:04Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Creating volume ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:05 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:05 devstack sudo[115772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 1073741824 Aug 26 00:27:05 devstack sudo[115772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:05 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b13c389c-22c2-4721-97fc-c4f20cfa9715 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:27:05 devstack sudo[115772]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 1073741824" returned: 0 in 0.479s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:05 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:05 devstack sudo[115778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 Aug 26 00:27:05 devstack sudo[115778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:06 devstack sudo[115778]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7" returned: 0 in 0.288s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eccd6c9f-259a-4ccb-87b1-63ccb502a981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7a5892-7935-46e6-ade8-2179fe84edd7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d32c4-e844-4587-8b81-01cbb9b04a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:06 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Volume volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 (ba7a5892-7935-46e6-ade8-2179fe84edd7): created successfully Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4d32c4-e844-4587-8b81-01cbb9b04a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (44613d5e-606f-47dd-bf02-e4f18991acd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:06 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5228543b-61c2-4be0-8446-958a1a0adea9 tempest-ProjectReaderTests-995475930 None] Created volume successfully. Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 of volume 1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a7b3b-0c07-4d8e-b1dd-ad46c2aa156d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:06 devstack sudo[115781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 Aug 26 00:27:06 devstack sudo[115781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:06 devstack sudo[115781]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" returned: 0 in 0.386s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1658b9be-68c1-4cfc-99b7-2724cd340778(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d34a13f-7996-4a83-95c0-b656c783121d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:06 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:06 devstack sudo[115787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 Aug 26 00:27:06 devstack sudo[115787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:07 devstack sudo[115787]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778" returned: 0 in 0.384s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:07 devstack sudo[115792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 Aug 26 00:27:07 devstack sudo[115792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Creating offline snapshot 2af6f6ac-c55d-43f9-84b8-f212d164449d of volume ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[902b103b-606d-4c28-b2a9-00b6c7e3d87f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:07 devstack sudo[115792]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" returned: 0 in 0.392s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:07 devstack sudo[115797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 Aug 26 00:27:07 devstack sudo[115797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:07 devstack sudo[115799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9 Aug 26 00:27:07 devstack sudo[115799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:07 devstack sudo[115799]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778.ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" returned: 0 in 0.246s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:07 devstack sudo[115797]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7" returned: 0 in 0.400s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9" released by "_delete_snapshot" :: held 1.535s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" released by "delete_snapshot" :: held 1.571s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:07 devstack sudo[115805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d 1G Aug 26 00:27:07 devstack sudo[115805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:07 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Created reservations ['2a5bdbd5-f29d-48fa-8346-6a9e3f7529a3', '3208069a-62a7-4800-aed6-12ccc39d8647', 'da03baf7-b669-482a-90e8-402644645160', 'ff5f07d9-7bf4-4b35-9020-29a8a022da9f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:08 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-a3db0733-f855-4a87-a5c2-ca024fc6da0f tempest-ProjectMemberTests-1845745940 None] Lock "cinder-ac42b933-5725-4e4b-84cf-44fd6e9ffcf9-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:08 devstack sudo[115805]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d 1G" returned: 0 in 0.453s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:08 devstack sudo[115818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d Aug 26 00:27:08 devstack sudo[115818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-1658b9be-68c1-4cfc-99b7-2724cd340778-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "cinder-1658b9be-68c1-4cfc-99b7-2724cd340778-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6af79ae-f87e-420d-acae-946c73fb18c5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:08 devstack sudo[115818]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d" returned: 0 in 0.325s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:08 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d is being set with open permissions: ugo+rw Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:08 devstack sudo[115824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d Aug 26 00:27:08 devstack sudo[115824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:08 devstack sudo[115823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 Aug 26 00:27:08 devstack sudo[115823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:08 devstack sudo[115824]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:08 devstack sudo[115831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info Aug 26 00:27:08 devstack sudo[115831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:08 devstack sudo[115823]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:08 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:08 devstack sudo[115833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778 Aug 26 00:27:08 devstack sudo[115833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:09 devstack sudo[115831]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:09 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info is being set with open permissions: ugo+rw Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:09 devstack sudo[115837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info Aug 26 00:27:09 devstack sudo[115837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:09 devstack sudo[115833]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-1658b9be-68c1-4cfc-99b7-2724cd340778" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-1658b9be-68c1-4cfc-99b7-2724cd340778" released by "delete_volume" :: held 0.679s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Created reservations ['3ade10da-1a9c-4564-900b-2275149da249', '5301cb19-4c51-4996-b16e-afcc117ff692', '5af5a69b-ea24-4db9-a420-b74bf64977b7', 'c2b89dd7-6d71-4b88-b2cd-18e6e160c7ec'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:09 devstack sudo[115839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:09 devstack sudo[115839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:09 devstack sudo[115837]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.info" returned: 0 in 0.255s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-26ca34dd-db84-4ee9-9566-806a7afafd35 tempest-ProjectReaderTests-995475930 None] Create snapshot completed successfully Aug 26 00:27:09 devstack sudo[115839]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.266s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:09 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:27:09 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6f2e033e-f5d7-4bfa-ba15-32be65ce5e7d tempest-ProjectMemberTests-1845745940 None] Lock "cinder-1658b9be-68c1-4cfc-99b7-2724cd340778-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (7ab015ee-9cee-4af8-a79f-146c0ed13ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737942c4-54f1-410c-84b3-64515d36c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737942c4-54f1-410c-84b3-64515d36c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643262904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:10Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661f1d5-5b85-4229-855a-a8b289dda202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6661f1d5-5b85-4229-855a-a8b289dda202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50944f7-fd4b-47f0-baf5-774519d677c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50944f7-fd4b-47f0-baf5-774519d677c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e', 'volume_name': 'volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cbb4a3-900d-4ceb-b35a-dd9c915e276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6cbb4a3-900d-4ceb-b35a-dd9c915e276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974cfe1f-fa6e-4120-8704-08bd2ca2bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Volume 94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e', 'volume_size': 1} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-643262904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:10Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Creating volume 94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:10 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:10 devstack sudo[115843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e 1073741824 Aug 26 00:27:10 devstack sudo[115843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-2af6f6ac-c55d-43f9-84b8-f212d164449d-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:10 devstack sudo[115843]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-2af6f6ac-c55d-43f9-84b8-f212d164449d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e 1073741824" returned: 0 in 0.462s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-2af6f6ac-c55d-43f9-84b8-f212d164449d" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-2af6f6ac-c55d-43f9-84b8-f212d164449d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Deleting offline snapshot 2af6f6ac-c55d-43f9-84b8-f212d164449d of volume ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] snapshot_file for this snap is: volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd124495-cc3c-41c7-b103-59ee8286dc91]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:10 devstack sudo[115849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e Aug 26 00:27:10 devstack sudo[115849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:10 devstack sudo[115848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d Aug 26 00:27:10 devstack sudo[115848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:10 devstack sudo[115849]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (974cfe1f-fa6e-4120-8704-08bd2ca2bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f122ea-9790-4148-9d73-b5371a8ce70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:10 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Volume volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e (94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e): created successfully Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f122ea-9790-4148-9d73-b5371a8ce70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:10 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (7ab015ee-9cee-4af8-a79f-146c0ed13ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:11 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c1f92efc-4444-45ee-8024-804dae090d5e tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:27:11 devstack sudo[115848]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d" returned: 0 in 0.368s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba7a5892-7935-46e6-ade8-2179fe84edd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1648e729-a14c-4f5a-8c4f-57e0835ebcc0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:11 devstack sudo[115856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 Aug 26 00:27:11 devstack sudo[115856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:11 devstack sudo[115856]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7" returned: 0 in 0.363s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:11 devstack sudo[115861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d Aug 26 00:27:11 devstack sudo[115861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:11 devstack sudo[115861]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d" returned: 0 in 0.330s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:11 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:11 devstack sudo[115866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d Aug 26 00:27:11 devstack sudo[115866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:12 devstack sudo[115866]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7.2af6f6ac-c55d-43f9-84b8-f212d164449d" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-2af6f6ac-c55d-43f9-84b8-f212d164449d" released by "_delete_snapshot" :: held 1.390s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" released by "delete_snapshot" :: held 1.415s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Created reservations ['045fe61f-e7f7-4c2f-ba4d-cfbf346654bb', '9d2093d2-46da-43f6-8d65-a0321c3ddbfd', '4eb98537-1dff-4215-8b6a-01b674be0e96', '4c6d10a9-2df7-4706-8b16-03fd45d2696a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:12 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Delete snapshot completed successfully. Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-3d786bba-7490-42de-86e3-37b2b5a10bfc tempest-ProjectReaderTests-995475930 None] Lock "cinder-2af6f6ac-c55d-43f9-84b8-f212d164449d-delete_snapshot" released by "delete_snapshot" :: held 1.555s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot 81c0b3ff-982e-4479-9306-43f5107d2946 of volume 94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ba90f8-67fb-47fa-9581-3b01ee11aab8]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:12 devstack sudo[115869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e Aug 26 00:27:12 devstack sudo[115869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:12 devstack sudo[115869]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" returned: 0 in 0.355s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:12 devstack sudo[115874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 1G Aug 26 00:27:12 devstack sudo[115874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-ba7a5892-7935-46e6-ade8-2179fe84edd7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "cinder-ba7a5892-7935-46e6-ade8-2179fe84edd7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9095834f-8202-486e-9c8e-6c1b8bca0286]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:12 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:12 devstack sudo[115876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 Aug 26 00:27:12 devstack sudo[115876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack sudo[115874]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 1G" returned: 0 in 0.412s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 Aug 26 00:27:13 devstack sudo[115881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack sudo[115876]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7" returned: 0 in 0.378s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7 Aug 26 00:27:13 devstack sudo[115886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack sudo[115881]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946" returned: 0 in 0.299s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 is being set with open permissions: ugo+rw Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 Aug 26 00:27:13 devstack sudo[115891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack sudo[115886]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-ba7a5892-7935-46e6-ade8-2179fe84edd7" returned: 0 in 0.246s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-ba7a5892-7935-46e6-ade8-2179fe84edd7" released by "delete_volume" :: held 0.692s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Created reservations ['f7b599b4-f378-4b0d-8bc0-3a6d0934b47e', '5b3924cd-8074-4f3f-873f-c472d55bd9d8', '2dd5f445-609d-4cab-9d71-4fda326ae5a6', '0bc00b1f-b34b-469a-a367-23394465666b'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115891]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack sudo[115895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:13 devstack sudo[115895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info Aug 26 00:27:13 devstack sudo[115897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:13 devstack sudo[115895]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:13 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Deleted volume successfully. Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c3ee6328-9980-41ac-80de-4ef6263b890a tempest-ProjectReaderTests-995475930 None] Lock "cinder-ba7a5892-7935-46e6-ade8-2179fe84edd7-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:13 devstack sudo[115897]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info" returned: 0 in 0.279s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:13 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info is being set with open permissions: ugo+rw Aug 26 00:27:13 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:13 devstack sudo[115901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info Aug 26 00:27:13 devstack sudo[115901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:14 devstack sudo[115901]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.info" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:14 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e17f248e-8cb6-4f77-bb97-b12f8741b73c tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (6c73ff0d-bcd8-4a3e-bcae-929af78f1870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5568c064-41a6-486b-ad41-ee494bb1fd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-81c0b3ff-982e-4479-9306-43f5107d2946-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5568c064-41a6-486b-ad41-ee494bb1fd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887279289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82886b-1896-497e-a770-edd84556e9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:14Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abcceb8-dbfd-4c7a-ab38-0a7056e74168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abcceb8-dbfd-4c7a-ab38-0a7056e74168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a3cc24-1538-4f3f-99e4-fed45a7224d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a3cc24-1538-4f3f-99e4-fed45a7224d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b82886b-1896-497e-a770-edd84556e9b7', 'volume_name': 'volume-9b82886b-1896-497e-a770-edd84556e9b7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28228a9a-32e4-4c05-b0e5-996da1a69d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28228a9a-32e4-4c05-b0e5-996da1a69d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d8c150-34ba-4c4f-ac66-1708d8a91b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:14 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Volume 9b82886b-1896-497e-a770-edd84556e9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b82886b-1896-497e-a770-edd84556e9b7', 'volume_size': 1} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-887279289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b82886b-1896-497e-a770-edd84556e9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:14Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Creating volume 9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:14 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-81c0b3ff-982e-4479-9306-43f5107d2946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:14 devstack sudo[115904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 1073741824 Aug 26 00:27:14 devstack sudo[115904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-81c0b3ff-982e-4479-9306-43f5107d2946" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-81c0b3ff-982e-4479-9306-43f5107d2946" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot 81c0b3ff-982e-4479-9306-43f5107d2946 of volume 94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1db0465-b9d6-44f2-a735-0ffe92a59e7b]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:14 devstack sudo[115906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 Aug 26 00:27:14 devstack sudo[115906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:14 devstack sudo[115904]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 1073741824" returned: 0 in 0.398s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:14 devstack sudo[115914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 Aug 26 00:27:14 devstack sudo[115914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:14 devstack sudo[115906]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946" returned: 0 in 0.406s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:14 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3f99da-5476-45b4-b9f5-6d5e7629b15d]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:15 devstack sudo[115916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e Aug 26 00:27:15 devstack sudo[115916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:15 devstack sudo[115914]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7" returned: 0 in 0.260s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43d8c150-34ba-4c4f-ac66-1708d8a91b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b82886b-1896-497e-a770-edd84556e9b7', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566654e0-1146-400c-a6df-dccbc0f1c116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:15 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Volume volume-9b82886b-1896-497e-a770-edd84556e9b7 (9b82886b-1896-497e-a770-edd84556e9b7): created successfully Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566654e0-1146-400c-a6df-dccbc0f1c116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (6c73ff0d-bcd8-4a3e-bcae-929af78f1870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:15 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-b51c2b6b-c270-45e7-89d9-06f4c3ffea7f tempest-ProjectReaderTests-995475930 None] Created volume successfully. Aug 26 00:27:15 devstack sudo[115916]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:15 devstack sudo[115923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 Aug 26 00:27:15 devstack sudo[115923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Creating offline snapshot 0b0ca002-31a2-42a1-954c-b49a2da7d0ba of volume 9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3575a5ad-841c-414a-b454-4e67831e2a8e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:15 devstack sudo[115927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 Aug 26 00:27:15 devstack sudo[115927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:15 devstack sudo[115923]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:15 devstack sudo[115930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946 Aug 26 00:27:15 devstack sudo[115930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:15 devstack sudo[115927]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:15 devstack sudo[115930]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:15 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e.81c0b3ff-982e-4479-9306-43f5107d2946" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:16 devstack sudo[115936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba 1G Aug 26 00:27:16 devstack sudo[115936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-81c0b3ff-982e-4479-9306-43f5107d2946" released by "_delete_snapshot" :: held 1.465s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" released by "delete_snapshot" :: held 1.487s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Created reservations ['8cb22428-658e-44f0-a27e-7aa25e6f0a17', '8cf341d8-6161-4d04-a17e-e1feac558be7', '683d3b50-30b3-4128-a42c-cd5b67154495', 'ae26f3e8-be38-4e53-ae3b-3ccc0b13b1bd'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:16 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ce29c07d-db31-4876-bc93-58effc8905f3 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-81c0b3ff-982e-4479-9306-43f5107d2946-delete_snapshot" released by "delete_snapshot" :: held 1.634s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:16 devstack sudo[115936]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba 1G" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b82886b-1896-497e-a770-edd84556e9b7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:16 devstack sudo[115942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b82886b-1896-497e-a770-edd84556e9b7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba Aug 26 00:27:16 devstack sudo[115942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "cinder-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:16 devstack sudo[115942]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b82886b-1896-497e-a770-edd84556e9b7 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba" returned: 0 in 0.328s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:16 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba is being set with open permissions: ugo+rw Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:16 devstack sudo[115947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba Aug 26 00:27:16 devstack sudo[115947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" acquired by "delete_volume" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50f78bb-2bbc-40f9-b2cf-7b09da3bdde0]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:16 devstack sudo[115949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e Aug 26 00:27:16 devstack sudo[115949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:16 devstack sudo[115947]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:16 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:17 devstack sudo[115952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info Aug 26 00:27:17 devstack sudo[115952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:17 devstack sudo[115949]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" returned: 0 in 0.374s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:17 devstack sudo[115957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e Aug 26 00:27:17 devstack sudo[115957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:17 devstack sudo[115952]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info" returned: 0 in 0.271s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:17 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info is being set with open permissions: ugo+rw Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:17 devstack sudo[115960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info Aug 26 00:27:17 devstack sudo[115960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:17 devstack sudo[115957]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e" released by "delete_volume" :: held 0.683s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:17 devstack sudo[115960]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Created reservations ['988622b9-3ce9-43c3-9ed7-ab4bc261750b', '14614e89-5e97-4cc3-b6e4-b8cb40643687', '0faa82c1-134a-4d97-b484-0b46ad11d685', '2e834b78-2f66-4de3-94b1-6510b6a92d37'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.info" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5a474519-6ee3-43a6-9c50-339be83a0891 tempest-ProjectReaderTests-995475930 None] Create snapshot completed successfully Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:17 devstack sudo[115964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:17 devstack sudo[115964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-0b0ca002-31a2-42a1-954c-b49a2da7d0ba-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-0b0ca002-31a2-42a1-954c-b49a2da7d0ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-0b0ca002-31a2-42a1-954c-b49a2da7d0ba" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-0b0ca002-31a2-42a1-954c-b49a2da7d0ba" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Deleting offline snapshot 0b0ca002-31a2-42a1-954c-b49a2da7d0ba of volume 9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] snapshot_file for this snap is: volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4cbc33-3c2b-4d20-b8c5-cb34c6fff5e5]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:17 devstack sudo[115964]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.275s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:17 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:27:17 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-128b0690-27c1-4cf0-b159-87d5e759927e tempest-ProjectMemberTests-1845745940 None] Lock "cinder-94f1d8ac-3fd4-48bb-b5b4-1fed2407f00e-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:17 devstack sudo[115967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba Aug 26 00:27:17 devstack sudo[115967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (94f60120-fe31-480c-9d69-88f0e89ea327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0954361-9af1-44c9-8a68-d1c38630638d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:18 devstack sudo[115967]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba" returned: 0 in 0.410s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b82886b-1896-497e-a770-edd84556e9b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0954361-9af1-44c9-8a68-d1c38630638d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982172361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950ddc52-4f3d-4728-9e06-13b8d7272e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:18Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65879758-7bee-4c12-9d2f-21378c3205ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65879758-7bee-4c12-9d2f-21378c3205ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbcbfe7-da92-4a95-b1d9-9dea13dbaf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbcbfe7-da92-4a95-b1d9-9dea13dbaf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950ddc52-4f3d-4728-9e06-13b8d7272e44', 'volume_name': 'volume-950ddc52-4f3d-4728-9e06-13b8d7272e44', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0399635e-aeb3-4ae3-837a-52e69eb69ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0399635e-aeb3-4ae3-837a-52e69eb69ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1b25e1-cd78-419d-b58e-df1606b58971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:18 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Volume 950ddc52-4f3d-4728-9e06-13b8d7272e44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950ddc52-4f3d-4728-9e06-13b8d7272e44', 'volume_size': 1} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-982172361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950ddc52-4f3d-4728-9e06-13b8d7272e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:18Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Creating volume 950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:18 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c0c26-c3db-4483-89b5-51808de3daf3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:18 devstack sudo[115973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 1073741824 Aug 26 00:27:18 devstack sudo[115973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:18 devstack sudo[115974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 Aug 26 00:27:18 devstack sudo[115974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:18 devstack sudo[115974]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:18 devstack sudo[115983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba Aug 26 00:27:18 devstack sudo[115983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:18 devstack sudo[115973]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 1073741824" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:18 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:18 devstack sudo[115985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 Aug 26 00:27:18 devstack sudo[115985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:19 devstack sudo[115983]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba" returned: 0 in 0.322s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:19 devstack sudo[115985]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44" returned: 0 in 0.259s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:19 devstack sudo[115991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba Aug 26 00:27:19 devstack sudo[115991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1b25e1-cd78-419d-b58e-df1606b58971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950ddc52-4f3d-4728-9e06-13b8d7272e44', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384268c-4c70-4db0-a058-9a5bcde81971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:19 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Volume volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 (950ddc52-4f3d-4728-9e06-13b8d7272e44): created successfully Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f384268c-4c70-4db0-a058-9a5bcde81971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (94f60120-fe31-480c-9d69-88f0e89ea327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-7979d404-966c-4284-8965-aeaf71ac869a tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:27:19 devstack sudo[115991]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7.0b0ca002-31a2-42a1-954c-b49a2da7d0ba" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-0b0ca002-31a2-42a1-954c-b49a2da7d0ba" released by "_delete_snapshot" :: held 1.510s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" released by "delete_snapshot" :: held 1.546s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Created reservations ['7ddd5cbe-4da0-4af2-95f2-e77644462e55', 'e73c410e-d00f-4f69-9927-f7490d523fce', '8123c853-2f0c-47bc-89c1-a8ab12812598', '6928b6e2-f952-4deb-9572-a5efd9113a36'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot f52a1d70-9909-46c3-82b7-d4e609a3042e of volume 950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7c54b-ac4b-4eb9-8095-cb0445fe9f91]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:19 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Delete snapshot completed successfully. Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6b8ae312-d8fb-4b62-a37a-bb6c81c3ddf8 tempest-ProjectReaderTests-995475930 None] Lock "cinder-0b0ca002-31a2-42a1-954c-b49a2da7d0ba-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:19 devstack sudo[115994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 Aug 26 00:27:19 devstack sudo[115994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:19 devstack sudo[115994]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44" returned: 0 in 0.360s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:19 devstack sudo[115999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e 1G Aug 26 00:27:19 devstack sudo[115999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-9b82886b-1896-497e-a770-edd84556e9b7-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "cinder-9b82886b-1896-497e-a770-edd84556e9b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:19 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515779a-6011-4b2b-8452-64afa5053312]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack sudo[116001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 Aug 26 00:27:20 devstack sudo[116001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:20 devstack sudo[115999]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e 1G" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack sudo[116006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e Aug 26 00:27:20 devstack sudo[116006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:20 devstack sudo[116001]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack sudo[116011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7 Aug 26 00:27:20 devstack sudo[116011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:20 devstack sudo[116006]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e" returned: 0 in 0.300s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:20 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e is being set with open permissions: ugo+rw Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack sudo[116016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e Aug 26 00:27:20 devstack sudo[116016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:20 devstack sudo[116011]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-9b82886b-1896-497e-a770-edd84556e9b7" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-9b82886b-1896-497e-a770-edd84556e9b7" released by "delete_volume" :: held 0.699s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Created reservations ['1117ab77-bd50-426f-abd1-f09e7aa50f3f', '28b800e0-69ab-45de-8aa4-6447b07ab32a', 'dcfdb65e-d287-4189-933b-35b5597a3294', '8feace88-bbdc-4581-8612-c42841e189e9'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:20 devstack sudo[116016]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:20 devstack sudo[116020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:20 devstack sudo[116020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:20 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:20 devstack sudo[116022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info Aug 26 00:27:20 devstack sudo[116022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:21 devstack sudo[116020]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Deleted volume successfully. Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-00db2169-a84a-4ff1-b8bd-3a02ab6c44e7 tempest-ProjectReaderTests-995475930 None] Lock "cinder-9b82886b-1896-497e-a770-edd84556e9b7-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:21 devstack sudo[116022]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info" returned: 0 in 0.274s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:21 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info is being set with open permissions: ugo+rw Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:21 devstack sudo[116026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info Aug 26 00:27:21 devstack sudo[116026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:21 devstack sudo[116026]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.info" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:21 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d38f66e-9aad-4399-882e-9f4f00648f5c tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (9f95ec78-e895-427e-a3b7-32128224204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb152bd4-259d-4b90-93ce-258a0e1c8352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-f52a1d70-9909-46c3-82b7-d4e609a3042e-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb152bd4-259d-4b90-93ce-258a0e1c8352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14724511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb18b817-8e9e-4367-a32b-8dc25abf0143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:22Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ee2a59-2925-4a84-b83c-31a0c07b1e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ee2a59-2925-4a84-b83c-31a0c07b1e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587c6140-1b4e-4055-b568-583f426e8345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (587c6140-1b4e-4055-b568-583f426e8345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb18b817-8e9e-4367-a32b-8dc25abf0143', 'volume_name': 'volume-bb18b817-8e9e-4367-a32b-8dc25abf0143', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d545e7ef-dd8f-4bfd-a0d3-6f9e06ff8b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d545e7ef-dd8f-4bfd-a0d3-6f9e06ff8b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b905fc8-a909-411c-9bfb-81872047845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:21 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Volume bb18b817-8e9e-4367-a32b-8dc25abf0143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb18b817-8e9e-4367-a32b-8dc25abf0143', 'volume_size': 1} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-14724511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb18b817-8e9e-4367-a32b-8dc25abf0143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:22Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Creating volume bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:21 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-f52a1d70-9909-46c3-82b7-d4e609a3042e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:21 devstack sudo[116029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 1073741824 Aug 26 00:27:21 devstack sudo[116029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-f52a1d70-9909-46c3-82b7-d4e609a3042e" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f52a1d70-9909-46c3-82b7-d4e609a3042e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot f52a1d70-9909-46c3-82b7-d4e609a3042e of volume 950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25dbae-bb7b-4fef-b823-bb015135cc7f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:21 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:21 devstack sudo[116031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e Aug 26 00:27:21 devstack sudo[116031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:22 devstack sudo[116029]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 1073741824" returned: 0 in 0.406s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:22 devstack sudo[116040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 Aug 26 00:27:22 devstack sudo[116040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:22 devstack sudo[116031]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e" returned: 0 in 0.406s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-950ddc52-4f3d-4728-9e06-13b8d7272e44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bad639-0b4f-4d99-b578-077a29c72b2c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:22 devstack sudo[116042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 Aug 26 00:27:22 devstack sudo[116042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:22 devstack sudo[116040]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b905fc8-a909-411c-9bfb-81872047845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb18b817-8e9e-4367-a32b-8dc25abf0143', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b019249f-6978-4849-b01b-60ddf3a5eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:22 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Volume volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 (bb18b817-8e9e-4367-a32b-8dc25abf0143): created successfully Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b019249f-6978-4849-b01b-60ddf3a5eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (9f95ec78-e895-427e-a3b7-32128224204c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:22 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-87b1559c-171e-44e3-b0ea-c2712f655338 tempest-ProjectReaderTests-995475930 None] Created volume successfully. Aug 26 00:27:22 devstack sudo[116042]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44" returned: 0 in 0.380s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:22 devstack sudo[116048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e Aug 26 00:27:22 devstack sudo[116048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Creating offline snapshot d18bb93b-0412-4a11-ad42-4bf56c73fe9b of volume bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a797f-d8b0-4cc7-838c-53188efaafe3]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:22 devstack sudo[116048]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e" returned: 0 in 0.340s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:22 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:22 devstack sudo[116052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 Aug 26 00:27:22 devstack sudo[116052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:22 devstack sudo[116055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e Aug 26 00:27:22 devstack sudo[116055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:23 devstack sudo[116055]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44.f52a1d70-9909-46c3-82b7-d4e609a3042e" returned: 0 in 0.244s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:23 devstack sudo[116052]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-f52a1d70-9909-46c3-82b7-d4e609a3042e" released by "_delete_snapshot" :: held 1.463s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" released by "delete_snapshot" :: held 1.488s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:23 devstack sudo[116062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b 1G Aug 26 00:27:23 devstack sudo[116062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Created reservations ['ed168d9d-a65e-4cd2-991f-ee98d4efb846', 'ae4c7f2f-2c7f-4b47-9201-0eadae3c5f08', '174e72b3-80d7-42bc-9988-125a617d45f8', '62471265-491c-4e00-9425-4942c6186d58'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:23 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-1e2e298c-473e-4217-9f92-96e6011ce7b8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-f52a1d70-9909-46c3-82b7-d4e609a3042e-delete_snapshot" released by "delete_snapshot" :: held 1.635s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:23 devstack sudo[116062]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b 1G" returned: 0 in 0.402s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:23 devstack sudo[116067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b Aug 26 00:27:23 devstack sudo[116067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-950ddc52-4f3d-4728-9e06-13b8d7272e44-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-950ddc52-4f3d-4728-9e06-13b8d7272e44-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d8ff1-417d-49a3-9502-2e6ee4ef4660]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:23 devstack sudo[116067]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b" returned: 0 in 0.338s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:23 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b is being set with open permissions: ugo+rw Aug 26 00:27:23 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:23 devstack sudo[116074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b Aug 26 00:27:23 devstack sudo[116074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 Aug 26 00:27:24 devstack sudo[116073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116074]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:24 devstack sudo[116079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info Aug 26 00:27:24 devstack sudo[116079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116073]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44" returned: 0 in 0.372s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:24 devstack sudo[116083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44 Aug 26 00:27:24 devstack sudo[116083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116079]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info is being set with open permissions: ugo+rw Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:24 devstack sudo[116086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info Aug 26 00:27:24 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116083]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-950ddc52-4f3d-4728-9e06-13b8d7272e44" returned: 0 in 0.261s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-950ddc52-4f3d-4728-9e06-13b8d7272e44" released by "delete_volume" :: held 0.693s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Created reservations ['2823b664-0d2d-4b32-8663-d87db4c5dc5d', '29796c35-2f6b-40eb-bc91-b6186bf7a277', 'ca8217f7-0df3-4a20-af99-a98eb0f3c4f2', '6e4ccf14-acbe-4dbf-8920-42ceb29a4dfc'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:24 devstack sudo[116090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:24 devstack sudo[116090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:24 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.info" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6c39ad92-f459-4a1c-bf29-fa96c9efb5b6 tempest-ProjectReaderTests-995475930 None] Create snapshot completed successfully Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-d18bb93b-0412-4a11-ad42-4bf56c73fe9b-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-d18bb93b-0412-4a11-ad42-4bf56c73fe9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-d18bb93b-0412-4a11-ad42-4bf56c73fe9b" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:24 devstack sudo[116090]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.279s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d18bb93b-0412-4a11-ad42-4bf56c73fe9b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Deleting offline snapshot d18bb93b-0412-4a11-ad42-4bf56c73fe9b of volume bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] snapshot_file for this snap is: volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:24 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c3d9bc-3b5d-425b-a99d-9cabefc25bbc]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:24 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-c9c65502-7e0d-490c-99c7-cdeb7c72dd85 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-950ddc52-4f3d-4728-9e06-13b8d7272e44-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:25 devstack sudo[116093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b Aug 26 00:27:25 devstack sudo[116093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:25 devstack sudo[116093]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb18b817-8e9e-4367-a32b-8dc25abf0143(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49fa482-a3b6-46b3-acf5-c49e09e5cfa9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (147c3337-af9d-4211-bc63-bfb620440707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da82e43-8739-4dba-a19d-9235a07adf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1da82e43-8739-4dba-a19d-9235a07adf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365929075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd00ffa-2959-447e-b286-4afe3943cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:25Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f25c7-8577-49d2-9c89-235de4aaf49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (571f25c7-8577-49d2-9c89-235de4aaf49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9617f-f39b-42dc-8b39-5a6a717e7f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc9617f-f39b-42dc-8b39-5a6a717e7f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd00ffa-2959-447e-b286-4afe3943cd88', 'volume_name': 'volume-0cd00ffa-2959-447e-b286-4afe3943cd88', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20167d93-4fdb-4f4e-a66f-5ef0416c5ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20167d93-4fdb-4f4e-a66f-5ef0416c5ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69ff793-f4e8-4065-bee7-a3142fbfc5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:25 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Volume 0cd00ffa-2959-447e-b286-4afe3943cd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd00ffa-2959-447e-b286-4afe3943cd88', 'volume_size': 1} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365929075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd00ffa-2959-447e-b286-4afe3943cd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3560be1ac30440969e5fa255512b291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:25Z,use_quota=True,user_id='9121c1de982141b98f6b155dec459795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Creating volume 0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:25 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:25 devstack sudo[116098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 Aug 26 00:27:25 devstack sudo[116098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:25 devstack sudo[116100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 1073741824 Aug 26 00:27:25 devstack sudo[116100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:25 devstack sudo[116098]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143" returned: 0 in 0.375s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:25 devstack sudo[116108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b Aug 26 00:27:25 devstack sudo[116108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:25 devstack sudo[116100]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 1073741824" returned: 0 in 0.425s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:25 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:26 devstack sudo[116110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 Aug 26 00:27:26 devstack sudo[116110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:26 devstack sudo[116108]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b" returned: 0 in 0.352s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:26 devstack sudo[116115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b Aug 26 00:27:26 devstack sudo[116115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:26 devstack sudo[116110]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88" returned: 0 in 0.264s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69ff793-f4e8-4065-bee7-a3142fbfc5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd00ffa-2959-447e-b286-4afe3943cd88', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e081788-5e72-4963-b909-b57387f70e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:26 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Volume volume-0cd00ffa-2959-447e-b286-4afe3943cd88 (0cd00ffa-2959-447e-b286-4afe3943cd88): created successfully Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e081788-5e72-4963-b909-b57387f70e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Flow 'volume_create_manager' (147c3337-af9d-4211-bc63-bfb620440707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-c06756f3-dea7-4c25-8f11-af9115a8b554 tempest-ProjectMemberTests-1845745940 None] Created volume successfully. Aug 26 00:27:26 devstack sudo[116115]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143.d18bb93b-0412-4a11-ad42-4bf56c73fe9b" returned: 0 in 0.250s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d18bb93b-0412-4a11-ad42-4bf56c73fe9b" released by "_delete_snapshot" :: held 1.481s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" released by "delete_snapshot" :: held 1.511s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Created reservations ['3ae11dee-b2a0-422d-a1e1-74d1a0b3079f', 'd4b35acf-e849-4676-8f38-9b0ffb74019e', '59983b12-a478-45c1-a9cf-3ca5bbdbbec2', 'f89111e1-0142-496c-8133-61bfc9ff535f'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:26 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Delete snapshot completed successfully. Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-91a62dbc-3dd8-48b2-8352-0f87022afdbf tempest-ProjectReaderTests-995475930 None] Lock "cinder-d18bb93b-0412-4a11-ad42-4bf56c73fe9b-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Creating offline snapshot fd67b37e-0194-4b1f-8571-ee7b7e2228a2 of volume 0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[299e84dd-3d69-42d1-baf7-c04844a5898c]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:26 devstack sudo[116119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 Aug 26 00:27:26 devstack sudo[116119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:26 devstack sudo[116119]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:26 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:27 devstack sudo[116124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 1G Aug 26 00:27:27 devstack sudo[116124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-bb18b817-8e9e-4367-a32b-8dc25abf0143-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "cinder-bb18b817-8e9e-4367-a32b-8dc25abf0143-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" acquired by "delete_volume" :: waited 0.023s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[59596246-977a-45f1-bbec-eb5d2d4e51ed]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:27 devstack sudo[116126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 Aug 26 00:27:27 devstack sudo[116126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:27 devstack sudo[116124]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 1G" returned: 0 in 0.418s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd00ffa-2959-447e-b286-4afe3943cd88 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:27 devstack sudo[116132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd00ffa-2959-447e-b286-4afe3943cd88 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 Aug 26 00:27:27 devstack sudo[116132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:27 devstack sudo[116126]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143" returned: 0 in 0.389s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:27 devstack sudo[116137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143 Aug 26 00:27:27 devstack sudo[116137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:27 devstack sudo[116132]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd00ffa-2959-447e-b286-4afe3943cd88 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2" returned: 0 in 0.282s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 is being set with open permissions: ugo+rw Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:27 devstack sudo[116142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 Aug 26 00:27:27 devstack sudo[116142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:27 devstack sudo[116137]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-bb18b817-8e9e-4367-a32b-8dc25abf0143" returned: 0 in 0.258s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-bb18b817-8e9e-4367-a32b-8dc25abf0143" released by "delete_volume" :: held 0.710s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=200,cinder:UPDATE=264,cinder:DELETE=29,cinder:INSERT=68 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=199,cinder:DELETE=16,cinder:UPDATE=263,cinder:INSERT=71 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Created reservations ['7527044b-eddd-4a73-bf79-20e494fffd59', '1885e529-9d22-4212-88db-f747b95ad9e3', 'd9b44522-4ee4-4730-a4f3-214620d45d4f', '3e00a712-ab45-4c12-a71f-3baef37a494d'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:27 devstack sudo[116142]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2" returned: 0 in 0.257s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:27 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:28 devstack sudo[116147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info Aug 26 00:27:28 devstack sudo[116147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:28 devstack sudo[116149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:28 devstack sudo[116149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:28 devstack sudo[116147]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info" returned: 0 in 0.289s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:28 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info is being set with open permissions: ugo+rw Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:28 devstack sudo[116149]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.268s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Deleted volume successfully. Aug 26 00:27:28 devstack sudo[116153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info Aug 26 00:27:28 devstack sudo[116153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-752fd370-e79a-4cb2-9e20-7b2a9ba4abbb tempest-ProjectReaderTests-995475930 None] Lock "cinder-bb18b817-8e9e-4367-a32b-8dc25abf0143-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:28 devstack sudo[116153]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.info" returned: 0 in 0.277s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:28 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-937beaf1-ccf9-4537-b831-356e1c0a47b6 tempest-ProjectMemberTests-1845745940 None] Create snapshot completed successfully Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (dde8849f-dfff-4e2b-9563-49b9fb1f3249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9417ec-21cb-4ddb-87a1-448485b569d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9417ec-21cb-4ddb-87a1-448485b569d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719989067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94314b5-6fcd-458a-a065-8a3fb8ad1b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:29Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dc8f61-3c31-400b-9d3d-7f2aeb0e3eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1dc8f61-3c31-400b-9d3d-7f2aeb0e3eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00a9a4f-fcea-4426-bb8c-07c9ae0c2ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00a9a4f-fcea-4426-bb8c-07c9ae0c2ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94314b5-6fcd-458a-a065-8a3fb8ad1b51', 'volume_name': 'volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463bbaf6-11f3-41bf-a9c9-7885e7d7b768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (463bbaf6-11f3-41bf-a9c9-7885e7d7b768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c7a4e8-1bc6-4fc0-a830-62c743d82b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:28 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Volume d94314b5-6fcd-458a-a065-8a3fb8ad1b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51', 'volume_size': 1} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-719989067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94314b5-6fcd-458a-a065-8a3fb8ad1b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e461e8a4d4864a3991ea1fa4f01c8c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:29Z,use_quota=True,user_id='dfc860e2b0c9457aa36df96f4a00414a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Creating volume d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:28 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:28 devstack sudo[116156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 1073741824 Aug 26 00:27:28 devstack sudo[116156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-fd67b37e-0194-4b1f-8571-ee7b7e2228a2-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-fd67b37e-0194-4b1f-8571-ee7b7e2228a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-fd67b37e-0194-4b1f-8571-ee7b7e2228a2" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-fd67b37e-0194-4b1f-8571-ee7b7e2228a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Deleting offline snapshot fd67b37e-0194-4b1f-8571-ee7b7e2228a2 of volume 0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] snapshot_file for this snap is: volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f63e2b-862e-4002-81a0-d963bc87d705]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:28 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:29 devstack sudo[116158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 Aug 26 00:27:29 devstack sudo[116158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:29 devstack sudo[116156]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 1073741824" returned: 0 in 0.434s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:29 devstack sudo[116166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 Aug 26 00:27:29 devstack sudo[116166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:29 devstack sudo[116158]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2" returned: 0 in 0.371s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd00ffa-2959-447e-b286-4afe3943cd88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d36962-eb7d-4bf3-8f99-6b6b2bbae379]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:29 devstack sudo[116168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 Aug 26 00:27:29 devstack sudo[116168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:29 devstack sudo[116166]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" returned: 0 in 0.253s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c7a4e8-1bc6-4fc0-a830-62c743d82b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7716855-9575-4806-95a4-f5da57df1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:29 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Volume volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 (d94314b5-6fcd-458a-a065-8a3fb8ad1b51): created successfully Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7716855-9575-4806-95a4-f5da57df1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Flow 'volume_create_manager' (dde8849f-dfff-4e2b-9563-49b9fb1f3249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:29 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-fba1a053-a8d1-4179-9193-65d1248e3dc2 tempest-ProjectReaderTests-995475930 None] Created volume successfully. Aug 26 00:27:29 devstack sudo[116168]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88" returned: 0 in 0.367s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:29 devstack sudo[116175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 Aug 26 00:27:29 devstack sudo[116175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Creating offline snapshot 7a7bde39-46c5-45a4-a8ad-1fdac24a8681 of volume d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba9f98b-79fa-4355-a6ea-47a16557e7c9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:29 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:30 devstack sudo[116179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 Aug 26 00:27:30 devstack sudo[116179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:30 devstack sudo[116175]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:30 devstack sudo[116182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2 Aug 26 00:27:30 devstack sudo[116182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:30 devstack sudo[116179]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" returned: 0 in 0.366s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 1G {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:30 devstack sudo[116182]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88.fd67b37e-0194-4b1f-8571-ee7b7e2228a2" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:30 devstack sudo[116188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 1G Aug 26 00:27:30 devstack sudo[116188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-fd67b37e-0194-4b1f-8571-ee7b7e2228a2" released by "_delete_snapshot" :: held 1.420s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" released by "delete_snapshot" :: held 1.443s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Created reservations ['b8c235d2-e7ca-4854-a65c-c861b866a95a', '48dfff5b-2a3d-4696-aa0b-a2091af444d2', 'f173e8c8-41ca-426b-9833-9dedb18d9998', 'f7f1a5b3-50aa-45f8-87f3-cafd4a00f7cb'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:30 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Delete snapshot completed successfully. Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-ba8a918a-3ba0-4996-9c1f-724c27e19024 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-fd67b37e-0194-4b1f-8571-ee7b7e2228a2-delete_snapshot" released by "delete_snapshot" :: held 1.580s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:30 devstack sudo[116188]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 1G" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:30 devstack sudo[116195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 Aug 26 00:27:30 devstack sudo[116195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:30 devstack sudo[116195]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 -F qcow2 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681" returned: 0 in 0.283s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:30 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 is being set with open permissions: ugo+rw Aug 26 00:27:30 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:30 devstack sudo[116200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 Aug 26 00:27:30 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-0cd00ffa-2959-447e-b286-4afe3943cd88-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-0cd00ffa-2959-447e-b286-4afe3943cd88-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5118a1-8230-4783-a09c-580fefa83141]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:31 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:31 devstack sudo[116202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 Aug 26 00:27:31 devstack sudo[116202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:31 devstack sudo[116204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info Aug 26 00:27:31 devstack sudo[116204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:31 devstack sudo[116204]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:31 devstack cinder-volume[94433]: WARNING cinder.volume.drivers.remotefs [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info is being set with open permissions: ugo+rw Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:31 devstack sudo[116202]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88" returned: 0 in 0.364s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:31 devstack sudo[116211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info Aug 26 00:27:31 devstack sudo[116211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:31 devstack sudo[116212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88 Aug 26 00:27:31 devstack sudo[116212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:31 devstack sudo[116211]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.info" returned: 0 in 0.243s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:31 devstack sudo[116212]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-0cd00ffa-2959-447e-b286-4afe3943cd88" returned: 0 in 0.251s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-quobyte-0cd00ffa-2959-447e-b286-4afe3943cd88" released by "delete_volume" :: held 0.684s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:31 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-213d0657-53db-4769-9248-b0e9d735b6c1 tempest-ProjectReaderTests-995475930 None] Create snapshot completed successfully Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Created reservations ['03c53520-8e2d-41a8-96bc-045cb62e0a3b', '799373f4-e048-4d62-bfd1-a88111ed2fa2', '921a6e55-6412-46c6-8144-51fc6d05b1b0', 'f37de9fa-c1d6-4f31-a23d-f49a01d5d693'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:31 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:31 devstack sudo[116217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:31 devstack sudo[116217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-7a7bde39-46c5-45a4-a8ad-1fdac24a8681-delete_snapshot" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-7a7bde39-46c5-45a4-a8ad-1fdac24a8681-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" by "delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-7a7bde39-46c5-45a4-a8ad-1fdac24a8681" by "_delete_snapshot" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-7a7bde39-46c5-45a4-a8ad-1fdac24a8681" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Deleting offline snapshot 7a7bde39-46c5-45a4-a8ad-1fdac24a8681 of volume d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] snapshot_file for this snap is: volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38aa17-8a72-4cdb-8232-12798ac8548e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:32 devstack sudo[116217]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.265s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:32 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Deleted volume successfully. Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-0edc25a2-2aa1-459d-b3ac-8876a09bddb8 tempest-ProjectMemberTests-1845745940 None] Lock "cinder-0cd00ffa-2959-447e-b286-4afe3943cd88-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:32 devstack sudo[116220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 Aug 26 00:27:32 devstack sudo[116220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:32 devstack sudo[116220]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681" returned: 0 in 0.399s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94433) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbacfc5-70e8-432b-828f-0adb1d4bb12f]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:32 devstack sudo[116225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 Aug 26 00:27:32 devstack sudo[116225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:32 devstack sudo[116225]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" returned: 0 in 0.382s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:32 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:32 devstack sudo[116230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 Aug 26 00:27:32 devstack sudo[116230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:33 devstack sudo[116230]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681" returned: 0 in 0.393s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:33 devstack sudo[116235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681 Aug 26 00:27:33 devstack sudo[116235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:33 devstack sudo[116235]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51.7a7bde39-46c5-45a4-a8ad-1fdac24a8681" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-7a7bde39-46c5-45a4-a8ad-1fdac24a8681" released by "_delete_snapshot" :: held 1.530s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" released by "delete_snapshot" :: held 1.556s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Created reservations ['dc6fb289-3ce8-4d8d-9fa9-ecea9785057e', '70581f8c-7e4e-4604-a956-f081deb60c36', '66d72400-da24-4518-a330-cfc2c1cc7347', '199cd603-4723-416e-bc02-10e70a410667'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:33 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Delete snapshot completed successfully. Aug 26 00:27:33 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-717aa627-7173-4878-88fd-432d7a410095 tempest-ProjectReaderTests-995475930 None] Lock "cinder-7a7bde39-46c5-45a4-a8ad-1fdac24a8681-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-d94314b5-6fcd-458a-a065-8a3fb8ad1b51-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "cinder-d94314b5-6fcd-458a-a065-8a3fb8ad1b51-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Acquiring lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" acquired by "delete_volume" :: waited 0.018s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a29b103-8964-4dab-ac6f-1c76e211a32a]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:34 devstack sudo[116240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 Aug 26 00:27:34 devstack sudo[116240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:34 devstack sudo[116240]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" returned: 0 in 0.361s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:34 devstack sudo[116245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51 Aug 26 00:27:34 devstack sudo[116245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:34 devstack sudo[116245]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:34 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "cinder-quobyte-d94314b5-6fcd-458a-a065-8a3fb8ad1b51" released by "delete_volume" :: held 0.675s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Created reservations ['7da254de-017f-4a6b-b949-e5256447c160', '4b0a9f4b-f012-42a7-86bb-e44434afea78', '5bff1450-1bc4-4df9-9fc5-bec656ef5430', 'c241e434-b077-4cf2-8d96-268fc631c08c'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:35 devstack sudo[116248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:35 devstack sudo[116248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:35 devstack sudo[116248]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.256s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:35 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Deleted volume successfully. Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-f057bbd7-cf7e-4902-88c8-9fc928594e2b tempest-ProjectReaderTests-995475930 None] Lock "cinder-d94314b5-6fcd-458a-a065-8a3fb8ad1b51-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Flow 'volume_create_manager' (0a07011b-5b49-4577-8f0a-15820eeccad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:35 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a176dd2-441e-479e-9723-8d54cd9f1371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a176dd2-441e-479e-9723-8d54cd9f1371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393113499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a8e8d6-52f5-4ffc-a23c-b3719b756028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0f3ee4297548908a5fc2520044d1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:36Z,use_quota=True,user_id='33de66b36fb840709de7f73db5d0f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f276fab-7365-43fa-a369-6780b03a49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f276fab-7365-43fa-a369-6780b03a49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9896e18f-ba9d-49fa-a47e-e8a404a79e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9896e18f-ba9d-49fa-a47e-e8a404a79e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a8e8d6-52f5-4ffc-a23c-b3719b756028', 'volume_name': 'volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86177d21-dc02-4c6b-94cb-aeb153694a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86177d21-dc02-4c6b-94cb-aeb153694a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b30fa-4700-42f7-aff0-44110af53a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Volume 61a8e8d6-52f5-4ffc-a23c-b3719b756028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028', 'volume_size': 1} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393113499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a8e8d6-52f5-4ffc-a23c-b3719b756028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0f3ee4297548908a5fc2520044d1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:36Z,use_quota=True,user_id='33de66b36fb840709de7f73db5d0f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Creating volume 61a8e8d6-52f5-4ffc-a23c-b3719b756028 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:36 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:36 devstack sudo[116251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 1073741824 Aug 26 00:27:36 devstack sudo[116251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:36 devstack sudo[116251]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 1073741824" returned: 0 in 0.455s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:36 devstack sudo[116257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 Aug 26 00:27:36 devstack sudo[116257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:36 devstack sudo[116257]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b30fa-4700-42f7-aff0-44110af53a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f81877-275a-4201-802e-014f8b5c84a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:36 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Volume volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 (61a8e8d6-52f5-4ffc-a23c-b3719b756028): created successfully Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0f81877-275a-4201-802e-014f8b5c84a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:36 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Flow 'volume_create_manager' (0a07011b-5b49-4577-8f0a-15820eeccad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:36 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-e3a8f9e8-795f-4d7d-ae1d-15c7bcfd5661 tempest-ProjectReaderTests-1770537814 None] Created volume successfully. Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Acquiring lock "cinder-61a8e8d6-52f5-4ffc-a23c-b3719b756028-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "cinder-61a8e8d6-52f5-4ffc-a23c-b3719b756028-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Acquiring lock "cinder-quobyte-61a8e8d6-52f5-4ffc-a23c-b3719b756028" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "cinder-quobyte-61a8e8d6-52f5-4ffc-a23c-b3719b756028" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb39e433-9a0f-4082-8b73-6620d53d12c9]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:37 devstack sudo[116260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 Aug 26 00:27:37 devstack sudo[116260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:37 devstack sudo[116260]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028" returned: 0 in 0.359s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:37 devstack sudo[116265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028 Aug 26 00:27:37 devstack sudo[116265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:37 devstack sudo[116265]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-61a8e8d6-52f5-4ffc-a23c-b3719b756028" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:37 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "cinder-quobyte-61a8e8d6-52f5-4ffc-a23c-b3719b756028" released by "delete_volume" :: held 0.643s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Created reservations ['fa5be40d-e861-4860-aafd-32173b6e7ccf', '363d903b-ce19-4023-b73f-6be1b6c7df69', 'd417f23b-439e-47e1-9000-78261a6c6fbd', '436da3e5-b64d-4dd9-9889-e24f5358ae21'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:38 devstack sudo[116269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:38 devstack sudo[116269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:38 devstack sudo[116269]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.246s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:38 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Deleted volume successfully. Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bf4a9111-1ccc-40b8-941f-bc2ec80eb6ba tempest-ProjectReaderTests-1770537814 None] Lock "cinder-61a8e8d6-52f5-4ffc-a23c-b3719b756028-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Flow 'volume_create_manager' (60834b69-bc2c-4f51-9f7e-aaaf9a325e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8134e9-92a9-4e39-bc75-276222e371e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8134e9-92a9-4e39-bc75-276222e371e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043142095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ddfc9b-859a-409b-85a4-0c51dd46e69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0f3ee4297548908a5fc2520044d1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:39Z,use_quota=True,user_id='33de66b36fb840709de7f73db5d0f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaef0df-1b6e-4907-9173-00fda3f41031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaef0df-1b6e-4907-9173-00fda3f41031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9184cc61-4779-467e-8a96-23cfa98e9e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9184cc61-4779-467e-8a96-23cfa98e9e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ddfc9b-859a-409b-85a4-0c51dd46e69d', 'volume_name': 'volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ef05f-88c3-4ae4-99fb-78930de99cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (389ef05f-88c3-4ae4-99fb-78930de99cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2473b634-4db9-47d8-af6f-4832f50c34fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:38 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Volume 69ddfc9b-859a-409b-85a4-0c51dd46e69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d', 'volume_size': 1} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043142095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ddfc9b-859a-409b-85a4-0c51dd46e69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d0f3ee4297548908a5fc2520044d1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:39Z,use_quota=True,user_id='33de66b36fb840709de7f73db5d0f2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Creating volume 69ddfc9b-859a-409b-85a4-0c51dd46e69d {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:38 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:38 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:38 devstack sudo[116272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d 1073741824 Aug 26 00:27:38 devstack sudo[116272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:39 devstack sudo[116272]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d 1073741824" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:39 devstack sudo[116277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d Aug 26 00:27:39 devstack sudo[116277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:39 devstack sudo[116277]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d" returned: 0 in 0.236s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2473b634-4db9-47d8-af6f-4832f50c34fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b73c70-a78d-4103-bb78-3bd96c2aa339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:39 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Volume volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d (69ddfc9b-859a-409b-85a4-0c51dd46e69d): created successfully Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b73c70-a78d-4103-bb78-3bd96c2aa339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Flow 'volume_create_manager' (60834b69-bc2c-4f51-9f7e-aaaf9a325e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:39 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9833df4c-6bf0-41bc-9bd5-5e7fc5869f10 tempest-ProjectReaderTests-1770537814 None] Created volume successfully. Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Acquiring lock "cinder-69ddfc9b-859a-409b-85a4-0c51dd46e69d-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "cinder-69ddfc9b-859a-409b-85a4-0c51dd46e69d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Acquiring lock "cinder-quobyte-69ddfc9b-859a-409b-85a4-0c51dd46e69d" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "cinder-quobyte-69ddfc9b-859a-409b-85a4-0c51dd46e69d" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a43eb0c-eef6-4fdb-98ae-8ced293d3cec]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:39 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:40 devstack sudo[116280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d Aug 26 00:27:40 devstack sudo[116280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:40 devstack sudo[116280]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d" returned: 0 in 0.345s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:40 devstack sudo[116285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d Aug 26 00:27:40 devstack sudo[116285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:40 devstack sudo[116285]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-69ddfc9b-859a-409b-85a4-0c51dd46e69d" returned: 0 in 0.235s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "cinder-quobyte-69ddfc9b-859a-409b-85a4-0c51dd46e69d" released by "delete_volume" :: held 0.616s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Created reservations ['e6ce07e9-88c7-4cb2-a251-d38af4917f54', '9f16fffe-c0b0-4765-a47a-8a204fd2ca0a', '6262006a-73aa-4668-831b-66fb79bf6d7f', '7f958f78-3831-4921-866c-1a6078e3b144'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:40 devstack sudo[116288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:40 devstack sudo[116288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:40 devstack sudo[116288]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.235s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:40 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Deleted volume successfully. Aug 26 00:27:40 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-6da608b6-8ed5-424b-99ce-6b67c8c57d5a tempest-ProjectReaderTests-1770537814 None] Lock "cinder-69ddfc9b-859a-409b-85a4-0c51dd46e69d-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (03520be5-e4a0-4746-81eb-e9287e3f7adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac078e4-2e31-4d5e-ac46-b634a2c92c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac078e4-2e31-4d5e-ac46-b634a2c92c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144567301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c27be-5a6e-49de-9701-43b192bc51c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:44Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8313172-4bf3-4526-b576-fef26355cf05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8313172-4bf3-4526-b576-fef26355cf05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aea0c1-a596-4b81-9d03-1eda417de1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2aea0c1-a596-4b81-9d03-1eda417de1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e7c27be-5a6e-49de-9701-43b192bc51c0', 'volume_name': 'volume-5e7c27be-5a6e-49de-9701-43b192bc51c0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160f8482-1b44-4bef-b9a2-656355795536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (160f8482-1b44-4bef-b9a2-656355795536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66890d7-7965-46be-a322-a63d6934622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:44 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Volume 5e7c27be-5a6e-49de-9701-43b192bc51c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e7c27be-5a6e-49de-9701-43b192bc51c0', 'volume_size': 1} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144567301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e7c27be-5a6e-49de-9701-43b192bc51c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:44Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Creating volume 5e7c27be-5a6e-49de-9701-43b192bc51c0 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:44 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:44 devstack sudo[116291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 1073741824 Aug 26 00:27:44 devstack sudo[116291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:44 devstack sudo[116291]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 1073741824" returned: 0 in 0.394s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:44 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:45 devstack sudo[116296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 Aug 26 00:27:45 devstack sudo[116296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:45 devstack sudo[116296]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66890d7-7965-46be-a322-a63d6934622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e7c27be-5a6e-49de-9701-43b192bc51c0', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c177c76c-6c0a-461f-8441-0512a71ad2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:45 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Volume volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 (5e7c27be-5a6e-49de-9701-43b192bc51c0): created successfully Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c177c76c-6c0a-461f-8441-0512a71ad2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (03520be5-e4a0-4746-81eb-e9287e3f7adf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:45 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-d81fde3a-6c37-4998-99d2-a1c5dfb7a700 tempest-ProjectReaderTests-1972771123 None] Created volume successfully. Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-5e7c27be-5a6e-49de-9701-43b192bc51c0-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-5e7c27be-5a6e-49de-9701-43b192bc51c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-quobyte-5e7c27be-5a6e-49de-9701-43b192bc51c0" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-5e7c27be-5a6e-49de-9701-43b192bc51c0" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdfbef4-cac0-40f1-8172-a072d6e04037]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:45 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:45 devstack sudo[116299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 Aug 26 00:27:45 devstack sudo[116299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:46 devstack sudo[116299]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0" returned: 0 in 0.348s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:46 devstack sudo[116304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0 Aug 26 00:27:46 devstack sudo[116304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:46 devstack sudo[116304]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5e7c27be-5a6e-49de-9701-43b192bc51c0" returned: 0 in 0.249s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-5e7c27be-5a6e-49de-9701-43b192bc51c0" released by "delete_volume" :: held 0.635s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Created reservations ['3d56bf96-dc26-4d0f-bfb7-86cacbb891e0', '6081bb57-1be4-4a8f-a11e-d54afaaf0748', 'acdd8941-3046-4b19-b493-49930adf70d5', 'a31be2ba-bc30-498d-81ac-996e47973527'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:46 devstack sudo[116307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:46 devstack sudo[116307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:46 devstack sudo[116309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:46 devstack sudo[116309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:46 devstack sudo[116307]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.245s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:46 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Deleted volume successfully. Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-8aab849c-b5bb-4549-95e9-78ac86531131 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-5e7c27be-5a6e-49de-9701-43b192bc51c0-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:46 devstack sudo[116309]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.262s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG oslo_service.periodic_task [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] Running periodic task VolumeManager._thread_info {{(pid=94433) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread count: 28 {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 00:27:46 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-590088be-8ba4-4fdb-92ec-523bc1d9fc99 None None] thread info: [<_MainThread(MainThread, started 140142169837696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94433) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (0269721e-3ed0-496e-8858-8982fdf9743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bc8fae-87f7-46d2-87c8-33469feea308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3bc8fae-87f7-46d2-87c8-33469feea308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459243770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58905e8-33ca-4f1f-be7f-2d7532f70891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:47Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef2d0ef-562e-4604-8f5f-c20df51049a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef2d0ef-562e-4604-8f5f-c20df51049a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea125a7-a4e3-4279-8596-7a6cca5e3659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea125a7-a4e3-4279-8596-7a6cca5e3659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58905e8-33ca-4f1f-be7f-2d7532f70891', 'volume_name': 'volume-c58905e8-33ca-4f1f-be7f-2d7532f70891', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e6d840-5f21-4e32-b71d-609163d8ed1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e6d840-5f21-4e32-b71d-609163d8ed1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a9721f-bcec-420e-a5e7-e1861399ad99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:47 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Volume c58905e8-33ca-4f1f-be7f-2d7532f70891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58905e8-33ca-4f1f-be7f-2d7532f70891', 'volume_size': 1} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459243770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58905e8-33ca-4f1f-be7f-2d7532f70891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:47Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Creating volume c58905e8-33ca-4f1f-be7f-2d7532f70891 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:47 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:47 devstack sudo[116313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 1073741824 Aug 26 00:27:47 devstack sudo[116313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:47 devstack sudo[116313]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 1073741824" returned: 0 in 0.404s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:47 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:47 devstack sudo[116319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 Aug 26 00:27:47 devstack sudo[116319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:47 devstack sudo[116319]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891" returned: 0 in 0.245s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a9721f-bcec-420e-a5e7-e1861399ad99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58905e8-33ca-4f1f-be7f-2d7532f70891', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c358ee03-d3e2-4125-86c7-f3aa6e9a3e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:48 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Volume volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 (c58905e8-33ca-4f1f-be7f-2d7532f70891): created successfully Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c358ee03-d3e2-4125-86c7-f3aa6e9a3e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (0269721e-3ed0-496e-8858-8982fdf9743f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:48 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-5d11a0b8-1fe7-400e-ae16-54836f1d6538 tempest-ProjectReaderTests-1972771123 None] Created volume successfully. Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-c58905e8-33ca-4f1f-be7f-2d7532f70891-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-c58905e8-33ca-4f1f-be7f-2d7532f70891-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-quobyte-c58905e8-33ca-4f1f-be7f-2d7532f70891" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-c58905e8-33ca-4f1f-be7f-2d7532f70891" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[566c5422-8211-4123-8a33-13fe83bf89fa]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:48 devstack sudo[116323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 Aug 26 00:27:48 devstack sudo[116323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:48 devstack sudo[116323]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:48 devstack sudo[116328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891 Aug 26 00:27:48 devstack sudo[116328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:48 devstack sudo[116328]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-c58905e8-33ca-4f1f-be7f-2d7532f70891" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:48 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-c58905e8-33ca-4f1f-be7f-2d7532f70891" released by "delete_volume" :: held 0.640s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Created reservations ['27c10d49-4087-4bea-abb5-e182a2c06ce8', '284d583b-6753-4448-830e-167245194a57', 'f1a910e9-cfc2-46a7-8904-3acf709e2bd1', 'e729f3b9-0cc6-47b2-a552-2e19bc8a486a'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:49 devstack sudo[116331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:49 devstack sudo[116331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:49 devstack sudo[116331]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.252s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:49 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Deleted volume successfully. Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-51fe03bb-8935-4501-baed-cf85ed0060b7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-c58905e8-33ca-4f1f-be7f-2d7532f70891-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (a44a5bf9-bb0c-4f9a-8273-cef5632373ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fccd5a-8519-46dc-892a-4f8dfa74e7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7fccd5a-8519-46dc-892a-4f8dfa74e7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857680414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff1f138-5db7-4b39-b3a2-46b514073528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:50Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b34ccf0-7ba0-41f8-b28d-8edfa086cd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b34ccf0-7ba0-41f8-b28d-8edfa086cd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8d639b-f080-4d00-9d21-a391bfb83c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8d639b-f080-4d00-9d21-a391bfb83c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff1f138-5db7-4b39-b3a2-46b514073528', 'volume_name': 'volume-8ff1f138-5db7-4b39-b3a2-46b514073528', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e0a005-3f53-40a0-93b7-4c0081fff048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2e0a005-3f53-40a0-93b7-4c0081fff048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d28d8e-5c01-4d34-bb00-7de0615767de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:49 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Volume 8ff1f138-5db7-4b39-b3a2-46b514073528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff1f138-5db7-4b39-b3a2-46b514073528', 'volume_size': 1} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-857680414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff1f138-5db7-4b39-b3a2-46b514073528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:50Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Creating volume 8ff1f138-5db7-4b39-b3a2-46b514073528 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:49 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:49 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:49 devstack sudo[116334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 1073741824 Aug 26 00:27:49 devstack sudo[116334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:50 devstack sudo[116334]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 1073741824" returned: 0 in 0.401s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:50 devstack sudo[116340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 Aug 26 00:27:50 devstack sudo[116340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:50 devstack sudo[116340]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528" returned: 0 in 0.237s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d28d8e-5c01-4d34-bb00-7de0615767de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff1f138-5db7-4b39-b3a2-46b514073528', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eeed56-23a2-4110-8e6a-73171015d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:50 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Volume volume-8ff1f138-5db7-4b39-b3a2-46b514073528 (8ff1f138-5db7-4b39-b3a2-46b514073528): created successfully Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eeed56-23a2-4110-8e6a-73171015d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (a44a5bf9-bb0c-4f9a-8273-cef5632373ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:50 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9d10b7b4-bc38-4190-80cd-d4a5a4ca0324 tempest-ProjectReaderTests-1972771123 None] Created volume successfully. Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-8ff1f138-5db7-4b39-b3a2-46b514073528-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "cinder-8ff1f138-5db7-4b39-b3a2-46b514073528-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-quobyte-8ff1f138-5db7-4b39-b3a2-46b514073528" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-8ff1f138-5db7-4b39-b3a2-46b514073528" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a2fc31-7fcc-4ea1-82d3-01a3f81e4a0e]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:50 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:51 devstack sudo[116343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 Aug 26 00:27:51 devstack sudo[116343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:51 devstack sudo[116343]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528" returned: 0 in 0.358s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:51 devstack sudo[116348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528 Aug 26 00:27:51 devstack sudo[116348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:51 devstack sudo[116348]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-8ff1f138-5db7-4b39-b3a2-46b514073528" returned: 0 in 0.248s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-8ff1f138-5db7-4b39-b3a2-46b514073528" released by "delete_volume" :: held 0.644s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Created reservations ['f9919144-9ac8-4ed0-8a3c-13f8cddd3f14', 'dcc04bf1-0f0f-423e-9421-86ab604ad650', '9263231c-4aaa-4c15-83d0-d6f35ae8d0c8', 'e5b1f421-3fc6-42c9-9e1e-83d5c459a934'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:51 devstack sudo[116351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:51 devstack sudo[116351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:51 devstack sudo[116351]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.238s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:51 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Deleted volume successfully. Aug 26 00:27:51 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-be8a7fa1-60e2-4368-86a2-795c97eddc3e tempest-ProjectReaderTests-1972771123 None] Lock "cinder-8ff1f138-5db7-4b39-b3a2-46b514073528-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.flows.manager.create_volume [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94433) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (42725590-d674-4804-b5e3-900222baa021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fd2779-ebf8-4b14-9cae-54c7fc732128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1fd2779-ebf8-4b14-9cae-54c7fc732128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665748297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f075bc7-a85c-42f0-bdce-8b4fb3715e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:52Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cd67b6-fa7b-446f-afff-30ad694ad3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cd67b6-fa7b-446f-afff-30ad694ad3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6f5be7-1fd6-4586-af9b-7d3b893cbef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f6f5be7-1fd6-4586-af9b-7d3b893cbef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f075bc7-a85c-42f0-bdce-8b4fb3715e18', 'volume_name': 'volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06b1274-957e-4405-92cd-aeab6e1a0a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06b1274-957e-4405-92cd-aeab6e1a0a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c27a7e-e320-4880-8f61-e1e98b1210ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:52 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Volume 5f075bc7-a85c-42f0-bdce-8b4fb3715e18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18', 'volume_size': 1} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-25T22:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-665748297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f075bc7-a85c-42f0-bdce-8b4fb3715e18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb70e20bc7474b4d815e3eb307cd902d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-25T22:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-25T22:27:52Z,use_quota=True,user_id='3bfb1f638a4442bdb3a77516d5c1def3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3127f53-51a9-4737-915e-71bcfbcf7b3f),volume_type_id=c3127f53-51a9-4737-915e-71bcfbcf7b3f)}" {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.remotefs [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Creating volume 5f075bc7-a85c-42f0-bdce-8b4fb3715e18 {{(pid=94433) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Selected osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 as target Quobyte volume. {{(pid=94433) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 00:27:52 devstack cinder-volume[94433]: INFO cinder.volume.drivers.remotefs [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] casted to osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9 Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 1073741824 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:52 devstack sudo[116354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 1073741824 Aug 26 00:27:52 devstack sudo[116354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:52 devstack sudo[116354]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 1073741824" returned: 0 in 0.409s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:52 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:53 devstack sudo[116359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 Aug 26 00:27:53 devstack sudo[116359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:53 devstack sudo[116359]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" returned: 0 in 0.242s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'} {{(pid=94433) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c27a7e-e320-4880-8f61-e1e98b1210ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18', 'volume_size': 1}' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31576057-a707-4eda-8425-1094769a56be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 00:27:53 devstack cinder-volume[94433]: INFO cinder.volume.flows.manager.create_volume [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Volume volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 (5f075bc7-a85c-42f0-bdce-8b4fb3715e18): created successfully Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31576057-a707-4eda-8425-1094769a56be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94433) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Flow 'volume_create_manager' (42725590-d674-4804-b5e3-900222baa021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94433) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 00:27:53 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-9294f7b9-5779-46a7-b84c-7e212ab2371c tempest-ProjectReaderTests-1972771123 None] Created volume successfully. Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-5f075bc7-a85c-42f0-bdce-8b4fb3715e18-delete_volume" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-5f075bc7-a85c-42f0-bdce-8b4fb3715e18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "cinder-quobyte-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" by "delete_volume" {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" acquired by "delete_volume" :: waited 0.014s {{(pid=94433) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b15df42-f6af-4b2d-94f1-86efbc224630]: (4, 'qcow2') {{(pid=95536) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:53 devstack sudo[116362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 Aug 26 00:27:53 devstack sudo[116362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:53 devstack sudo[116362]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" returned: 0 in 0.349s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:53 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:53 devstack sudo[116367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18 Aug 26 00:27:53 devstack sudo[116367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:54 devstack sudo[116367]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195/volume-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" returned: 0 in 0.247s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-quobyte-5f075bc7-a85c-42f0-bdce-8b4fb3715e18" released by "delete_volume" :: held 0.634s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.quota [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Created reservations ['40427142-c6ba-49d4-a2be-92f9fd450992', '42062715-cd70-49d1-9f41-908c61631dde', '02fc573f-2f63-4abc-b2c9-3d3526506cb5', 'e7efcd8f-b057-4759-bbab-a768030df193'] {{(pid=94433) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9': None} {{(pid=94433) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.volume.drivers.quobyte [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-042a1e1e-6d7e-42b5-a650-fe959db792f9'] {{(pid=94433) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.lockutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94433) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 00:27:54 devstack sudo[116370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195 Aug 26 00:27:54 devstack sudo[116370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 00:27:54 devstack sudo[116370]: pam_unix(sudo:session): session closed for user root Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG oslo_concurrency.processutils [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/a55cf497d715a909aeba8e5304f8d195" returned: 0 in 0.239s {{(pid=94433) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.manager [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Notifying Schedulers of capabilities ... {{(pid=94433) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 00:27:54 devstack cinder-volume[94433]: INFO cinder.volume.manager [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Deleted volume successfully. Aug 26 00:27:54 devstack cinder-volume[94433]: DEBUG cinder.coordination [None req-bff11016-0d5f-4b67-8c9b-0bcd8e1ad0c7 tempest-ProjectReaderTests-1972771123 None] Lock "cinder-5f075bc7-a85c-42f0-bdce-8b4fb3715e18-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=94433) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 00:28:04 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:INSERT=28,cinder:UPDATE=106,cinder:SELECT=64,cinder:DELETE=10 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 00:28:04 devstack cinder-volume[94433]: DEBUG dbcounter [-] [94433] Writing DB stats cinder:SELECT=76,cinder:INSERT=25,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=94433) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}